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1 


Introduction and Summary 


1- 1 Introduction 

The problem of estimation when the parameter space is 
restricted dates back to Hammersley (1950). He gave several 
examples of the situation where it is natural to restrict the 
parameter space to a sub space. Restriction of the parameter 
space reflects the prior information about the values of the 
parameter. Hammersley considered estimation of the means of 
normal and Poisson distributions vhen they are known to take 
only integer values. This type of problem arises, for example, 
in the estimation of the molecular weight of insulin vhere 
chemical theory restricts the unknown molecular weight to an 
integer. Katz (196 1) considered estimation of E (X) vhere X 
has a distribution with the density in the exponential family, 

p^(x) = /3(cj) e^^ , X £ ^ and co £ T , 
where T = {w: O(co)) ^ = / e^ dx < '®}. 

When the parameter co is known to be bounded below by a cx>nstant, 
say a, Katz considered the generalized Bayes estimate 

6(x) = X + 0(a) e^^/ (/ 0(co) e^ di) ' 

a ■ . ^ ^ / 

with respect to the uniform prior on (co: co > a }. He showed that 
6(x) is admissible when the loss function is scjuared error. He 
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also proved its minimaxity viien is normal. A result, vdiich 

gives sufficient condition for admissibility of an estimator with 
bounded risk, was given too. The condition is quite similar to 
Karlin's ( 1958) condition for admissibility. 

Gupta and Rohatgi (1981) took up continuous distributions 
with unknown mean p and unknown variance. They suggested several 
estimators for p- vAien it is known that p lies in an interval (a,*") 
(or (- 00 , b)). The estimators suggested lie completely in the range 
(a,oo) (or (-<»,b)). The performances of these estimators were 
compared numerically for the normal, exponential and weighted 
difference of two independent chi-square distributions, weights 
being the unknown parameters. The last distribution occurs in 
balanced one-way variance components problem. It is the distribu- 
tion of the usual unbiased estimator of the main effects variance 
component. 

For a general density f(x,©) , vhere 0 lies in a closed and 
compact space Q, Ghosh (196 4) considered the estimation of a bounded 
real function g (9) -when the loss function is 

L(e,a) = lg(0)-al^ , p > 1 . 

Restricting attention to the class F^^ of estimators with bounded 

risk, he proved that a unique minimax estimator exists provided 

g(0) and f (x, 0) are continuous functions of 0. Under some further 

conditions on f(x, 0), it was shown that there exists a class C of 

estimators vhich is complete and every minimax sequence in C is a 

uniform minimax sequence. A sequence {6^-^} of estimators is said 

to be minimax if Sup R(0,6 ) ** Sup R(0,6^) as n -♦ <» , where 6^ 

eGQ ^ QEQ ° 
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is the unique minimax estimator. It is said to be a uniform mini- 
max sequence if R(0,6^) -* R(0, 6^) uniformly in 0 as n -» <». 

In general the determination of minimax estimators is 
difficult. Let { v., v^, . . . } be the basis of Ghosh showed 

that an approximation to the minimax estimator 6^ can be obtained 
by 6^, the estimator minimax in the linear sxabspace spanned by n 
basis vectors . . . , This method may be helpful^ particularly ;■ 

in the problems which are slight variations of the standard problem! 

I 

If 6 is the conventional minimax estimator for the standard probler 
one can start off with a basis vhich has 6 as the first element. i. 
As an application of the above method, Ghosh considered 
the problem of estimating the mean of a random N(0,1) variable, 

0 £ [-ra/m]. When © is unrestricted, the sample mean X is the usual; 
minimax estimator. Thus, for estimating 0 restricted to C-m, m], | 

Ghosh started with basis X, X^, etc. and constructed a uniform | 

F; 

minimax sequence. It turns out that the estimators obtained are 
too complicated to evaluate and the limiting minimax estimator 
cannot be found explicitly. However, the results indicate that ; 

i 

the minimax estimator is Bayes with respect to a least favourable | 
prior concentrated on a finite number of points. When the interval' 
containing © is small enough (for m < = 1.05 approximately), 

Casella and Strawderman (1981) showed that the prior is symmetric j 

and puts all its probability on _4m. For somewhat wider intervals 

■ 

they obtained sufficient conditions for the minimaxity of an- 
estimator which is Bayes with respect to a three point prior. 

These conditions are satisfied for m £ (1.4, 1.6). However, numer- i 

ical evidence suggests that the conditions -will be satisfied for | 
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m £ (m^/ 2) . As m increases, the nature of the least favourable 
prior becomes complicated and nxmerical techniques are necessary 
to determine the support points and the probabilities assigned to 
them. 

Bickel (1981) studied the behaviour of the least favourable 
prior distribution and the rainimax rish for large m. Using an 
identity of Brown (1971), he exhibited that the minimax risk can 
be obtained by minimizing the Fisher information among prior distri- 
butions concentrated on [-m, m]. Earlier, it was shown by Huber 
(197 4) that the distribution G. with density 

(y) = Cos^(^ y) lyl jS 1 ' 

■ i 

I 

= 0 , el sevhere I 

i: 

minimizes Fisher information among distributions on [-1, l], Bickel : 
rescaled the least favourable priors to [-1,1] and showed that they! 
converge weakly to G. as m -♦ oo . Thus, G. is the approximate least i 

■*' 2 ' i 

favourable prior. The minimax risk is 1 - — + 9-s m •*«». | 

m m^ I 

Gatsonis, MacGibbon and Stravderman (1987) numerically | 

compared performances of the Bayes estimator 6^^ with respect to the j 

uniform prior on [-m,m], the maximum likelihood estimator, the 

X 2 Tt 

Bayes estimator with respect to Bickel ' s prior — Cos y) / • yr S 

and some other estimators. They concluded that 6^ is a good choice 
among these. 

Melkman and Ritpv (1987) generalized the results of Bickel 

to a distribution with the location parameter density. They showed 

4 S 

that the only conditions required are EX = © and EX < ». 

Bickel (1981) also J considered the estimation of the mean 
of a p- variate normal distyj^ibution (p > 2) when the mean vector is | 
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restricted to take values inside a sphere. He showed that the 
results for p = 1 can be extended to p 2 2. 

Moors (1985) discussed truncated estimation problems invari- 

<s> ■ 

ant under a finite group G with the induced group G a subgroup of 
the group of linear transformations. These problems are called 
linvariant by Moors. When the loss function is quadratic, under 
mild conditions he obtained a sxibspace of the action space for 
each observed x such that any linvariant estimator taking values 
outside A„ with positive probability would be inadmissible. The 
dominating estimator was provided and various applications of the 
resxilt were given. A striking consequence of this result is that 
in tnincated estimation problems, linvariant estimators taking 
values on or near the boundary of the parameter space would be 
inadmissible. Moors, in particular, studied the problem of estima- 
ting binomial parameter 6, ■when 0 is restricted to an interval 
[l-P,P] for some known P £ l]. This problem has its origin in 

randomized response models, where the design of the experiment 
itself leads to a restriction of the parameter space (see, for exampl 
Horvitz et al. (1976)). Moors obtained minimax estimators and 
the least favourable priors nxjmerically for specific values of P 
and for n = 3(1)16 -when the loss function is quadratic and for 
n = 3(1)11 when the loss function is w'eighted quadratic. 

Estimation of binomial parameter 0, when the parameter 
space is a subset of [o, l], has been considered before. Skibinsky 
and Cote (196 3) investigated the case -when the prior knowledge 
implies that © is outside the interval [l-P,p] with a given small 
probability. They showed that the sample proportion is inadmissible. 
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Blviin and Rosenblatt (1967) studied'? -minimaxity when 9 £ [o,p], 
Rafsky (1976) noted that for finite populations, the parameter 
space is, in fact, discrete. Using this fact he obtained an esti- i 
mator better than the sample proportion. Schafer (1976) offered * 

some alternative estimators to the usual minimax estimator, when 
© £ (0,1). This problem is encountered in estimation of tail areas 
in an unspecified positive probability distribution function on 
(O , co) . i 

Next, we discuss in detail two special problems in restri- 
cted parameter spaces, which have received attention of many resear- 
chers. These are the estimation of ordered parameters when the ! 

ordering is known, and the estimation of the common location of 

[ 

several populations. ^ 

I 

1. 1. 1 A Review of the Problem of Estimating Ordered Parameters j 

The problem of estimating ordered parameters when the i 

ordering is not known is widely discussed in literature (^ee 

I 

Dudewicz and Koo (1982) for a detailed bibliography). However, not ; 
much attention has been paid to the case vhen the ordering is i 

known. This is, clearly, a problem of estimation in restricted | 

parameter space and has its origin in various agricultural, indus- 
trial and economic experiments. Suppose we want to estimate the 
average yields ©j^ and ©2 under treatments 1 and 2 respectively; j 

treatment 1 is using a certain fertilizer for the crop while 
treatment 2 is not using any fertilizer. Then it is possible to 
assert a priori that 0^ > © 2 * .In estimating the average incomes 
say 0 ^, i = 1, . . . , 4 of four classes of employees in a certain 
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establishment, it is quite reasonable to assume an ordering among 
©^' s according to the grade of employees. In the development of 
a system, engineering changes are made in stages to correct design 
deficiencies and thereby to increase reliability. Thus, if we have ^ 
k stages in vhich the changes are made, then at each stage we 

expect the average production to increase. If 0^ is the average 

t. 

production at the i stage, we may assume that 0^ < ... < 0^. 

Most of the literature on estimating ordered parameters is 
concerned with maximxam likelihood estimation for specific distri- ;i 
butions. Barlow, Bartholomew, Bremner and Brunk (197 2) give detailed 
description of the results in' this areal 'Recently) Sackrowitz and 
Strawderman (197 4) considered admissibility question of the maximum 
likelihood estimators (MLE's) of the parameters of k binomial 
populations, when the parameters have a known ordering. Suppose * 
Xi,...,Xj^ are k independent random variables with having a i 

binomial distribution with parameters 0^ and i = l/...,k. Then, 

for estimating 0 = (0^,...,©^) when _< ... _< 0^, with the loss 
function the sum of strictly convex losses, Sackrowitz and Straw- 
derman showed that the MLE is inadmissible under the following | 

conditions: I 

(i) If k = 2, n^ 1, n 2 ^ 1 and n^+n^ > 

(ii) If k = 3, (n^,n 2 ) ^ (1,1) and n^+n 2 +n 2 > 7, 

(iii) If k > 3, n^ + n2 + • • • + >\ > 7 . 

The inadmissibility of the MLE was proved by showing that 
it is not admissible i-n a suitably chosen subproblem and this fact| ? 
was proved by showing that the MLE cannot be Bayes in that sub- 
problem. However, this method of proving inadmissibility does not 
yield a better estimator. Sackrowitz (1982) presented a method of 
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constructing, in the cases v^ere the MLE is inadmissible, an 
estimator which is better than the I'4LE. The loss function was 
taken to be the sum of squared errors. The argument used in obta- 
ining the improvement is the following; Consider a nonempty subset 

•ic 'k 

S of the sample space S and let X be the restriction of X = 
(X^,.,.,Xj^) to S* in the sense that = x) = Pq(X = £ S*) . 

It can be easily proved that any estimator of 0 inadmissible in the 

k k 

set up(X ,S ) is also inadmissible in the original set up (X,S). 

Now the subsets of S where the restricted MLE is inadmissible are 
identified and a better estimator is obtained by altering the MLE 
on these subsets. However, there are practical problems in this 
approach. A general expression for the new estimator cannot be 
given and as there is no unique ordering on the procedure for 
identifying sets where the MLE is inadmissible, the method results 
in a nxamber of different estimators, each one better than the MLE. 
Computational difficulties are faced while determining the amount 
of improvement. Numerical comparisons for a few simple cases of 
k = 2 show a marginal reduction in the risk over a very large 
portion of the parameter space. 

For the problem of simultaneous estimation of two ordered 
binomial parameters, Katz (1963) suggested a mixed estimator which 
improves an estimator = ( 6 ^/ ^ 2 ^' satisfying the order rela- 

tion 6 ^^ _< 62 with positive probability. The mixed estimator ^ 

■ ; . a ' 

for is 

4 (l-a) 62 , (l-a)6^ + , 
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where a 


1, if6 2_^62 / 

-f* “f* 

a , if 6^ > 62 » 0 < a < 1 . 


Katz obtained estimators minimax in the class 0 _< < 1]. 

a 

He also considered the problem of simultaneous estimation of two ; 
ordered normal means 0^ and 0^; ©j_ S ^2' variances are 

the same and known. He proved admissibility and minimaxity of the 
generalized Bayes estimator of with respect to the uniform 

prior on the space 0 ^ _< 62* However, as Blumenthal and Cohen { 1968 b) 
mention, his proofs are inadequate. 

Blumenthal and Cohen (op. cit. ) considered the estimation of 
location parameters and ©2 (©j|_ j< ©2^ from two continuous popu- 
lations, vhen the loss function is the sum of squared errors. They j 
developed sufficient conditions for the minimaxity and admissibility ^ 
of the generalized Bayes estimator of © with respect to the | 

uniform prior on the space ©^ _< ©2* I 

Sackrowitz (197 0 ) considered independent discrete random 


variables X^, X2, ... with probability functions f (x^, ©^) , f (X2/ ©2) / • • • 
respectively. Estimation of ©^^ on the basis of (X^, . , . , Xj^) , when 
©2 ^ ©2 — ••* — ®k' taken up. Sackrowitz showed that the minimax 
value is the same for all k = 1 , 2 , ... . If t(X^, ...,X^) is an 
admissible estimator for then the estimator t (Xj^_i_^, . . . , Xj^_^g) is 


admissible for Hence if t(X^) is admissible for ©^ with the 

constant risk then t(Xg) will be the unique admissible minimax 
estimator of © among those based on (X^, ...,X ). Sackrowitz also 
obtained a sequence of estimators which is asymptotically sub- 
minimax (as s -* op) . A subminimax estimator is one which has 
maximum risk slightly larger than the minimax risk but the risk 
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function substantially, below that of a minimax estimator over a 
large portion of the parameter space. 

Cohen and Sackrowitz (1970) considered the above estimation 
problem for continuous random variables with location parameter 
densities. When the variables are normal with known unequal vari- 
ances and k = 2, they showed that an estimator based on alone 
with bounded risk is inadmissible. They also considered the gener- i 
alized Bayes estimator of ©2 with respect to the uniform prior on 
0 ^ ©2 and proved it to be admissible and minimax. For a general 

k they considered normal populations with equal known variances and 

i. 

alone. For 

I 

symmetric location parameter densities if Pq(X^-X 2 > 0) > 0 for ' 
some 0, ©j^ _< ©2 then X 2 was proved to be inadmissible. A similar ; 

result for confidence intervals was obtained. i 

i 

1. 1. 2 A Review of the Problem of Estimation of Common Location | 

1 

Let X = X = ( , Y^) be independent 

2 2 

random samples from N(>i,a^) and N(p,a 2 ) populations respecti vely, ! 

2 2 

The variances and 02 are unequal and -unknown. We estimate p | 

i 

when the loss function is 
= (M-m) ^ 

or L 2 (M/M) = . 

This problem of estimating the common mean of tvoo normal populations! 

/ ^ ^ ^ j 

has its origin in the problem of recovery of interblock information | 

■ ! 

in balanced incomplete block designs. Here two independent unbiased] 

‘I 

estimators (intrablock and interblock) for the treatment contrast 
are available. The aim is to csombine the two estimators to get a 


obtained a class of admissible estimators based on 
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better estimator. The problem of recovery of interblock informa- 
tion has. received considerable attention (see Kubokawa (1988) for 
a. bibliography) . Various combined estimators for M have been sugg- 
ested. One of the most commonly used estimators of p. was given by 
Graybill and Deal (1959), 

S2X + S^Y _ _ 

— g + S * * ^1 and being the sample means and 

sample sum of squares. Graybill and Deal shov^ that is 

unbiased and dominates both X and Y if and only if both the sample 
sizes are at least 11. 

When both m and n are less than 11, p^^ does not improve 
X or Y. For this case, Zacks (1966) proposed two classes of testi- 
mators: 


^(P*) 


-^ < ^ < P* 

P ^1 


1 < P < 


otherwise 


and p (P ) = Y 


if ^ 

^1 p* 


^ < P* 

p 


. ^ 2 * 
if ~ > p , 

^1 


1 < P < 


When the samples are of equal size 3, Zacks obtained esq)! i- 
cit formulae of the efficiency functions of p(p*) and p(p*), effi- 


ciency of an estimator p* is defined as Var (A ) /Var-(p* ) , Oiere 


(0^ X + Y)/(o^ + ^ The esqjressions of the efficiency functionj 


are quite complicated and numerical calculations are carried out. 


It is observed that the estimator p(p*) dominates p(P ) in 
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1 2 2 

{Pig<Pj< 6 }, Vvtiere p = ^ 2 / y values of p*. For p* 

close to one, M is uniformly better than u and the efficiency of M 

rv> 

exceeds that of jj. by about 25^ in the neighbourhood of p = 1 . 

Zacks recommends the estimator ^(p*). 

The case, vjhen the samples are of equal size 5, was found 
to be of no special interest. In fact, the efficiency function of 
A(l) itself is very complicated. It was observed numerically that 
the gain in efficiency over the range 1 _< p _< 6 is very slight. 

Mehta and Gurland (1969) investigated the admissibility of 

A, 

jjt^Q when the samples are of equal size and P > 1. They considered 
estimators of the form 


p(cp) = 9(F)X + (1-9(F))Y , F = ^2^^! 
and proposed estimators 


(i) 


T^ = P (9) , where 


9(F) = 


C+F . 
C+A+F ' 


(ii) T^ = p(9), vhere 


9(F) = 1/2 , if F < k 


F+A ' 


if F > k 


(iii) T 3 = M(9), where 

<f(f) . -L c ± a /I 

(C+F) / 



with A, C, k° specific constants to be chosen. It was shown that 

(i) corresponding to each n, there exists a T^ vhich dominates 

(ii) the best choice of T 2 , for a specified A, is given by k° = A 

(iii) for n=3, the limiting variance of T^ becomes infinite as p -• » 
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The efficiencies of and are compared numerically: 

with that of for specific choices of A, C, and P when n = 3* 

The estimators T^ and T^ are found to be more efficient than 
for P > 1. For 1 ^ P < 54.6/ T^ is more efficient than Mqj-). 

Although T^, T^ and T^ perform better than Mqq/ T^ is the best, ini; 
view of the fact/ that it has higher efficiency than that of 
for all p _> ^* If we are interested in a paarticular intervaO. of p 
values/ say 1 < p < 20/ then T^ is the best. ; 

i 

For n = 5, 7, 9 and 11 and P in the interval [l/ 54.6) it 
is exhibited that T^ with A = 1 and C =.4 performs better than Mqq- 
For unequal sample sizes/. Nair (1982) showed that the ' 

O A 

estimator T^ with A = k = 1 is uniformly better than p^^ when > 

2 2 ! 
02 > cr^ and gave an upperbounfl for the improvement in the risk. ; 

Zacks (1970) considered estimators equivariant under the j 

transformations X. - a + 3X. / Y. a + 8Y. / i = 1/ . . . , n/ - oo < a < «>,l 

j- I X 1 I 

jS / 0. It was shown that these estimators are unbiased and also an 
ejqpression for Bayes equivariant estimators was obtained. It was 

shown that X is a minimax estimator/ when the loss is L 2 . Zacks j 

1 

also gave the form of fiducial equivariant estimators and showed 

i 

that Bayes equivariant and fiducial equivariant estimators are i 

admissible. 

Cohen and Sackrovhtz (1974) considered the samples of equal 
size and obtained classes of minimax estimators when the loss is L 2 . 
These estimators dominate X for n _> 6 (see VJijsman (1976) for the 
correction). Using a symmetry argument it was shown that the 
estimator 
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^ ( Z) ) X + G* ( Z) Y , 

where G* (z) = F(l, ^ 0 < 2 < 1 

n-3 1 /5-ns /n+ls lx ^ ^ 

= - F(l, (—),(—), -) £orz>l, I 

and F is the hypergeometric function; is better than both X and Y 
for n > 10. Cohen and Sackrowitz also gave confidence intervals 
which dominate (X-h, X+h) . 

Brown and Cohen (197 4) obtained estimators better than X 

i 

if the first sample size is greater than 1 and the second sample ' 
size is greater than 2. Some of these estimators can be extended i 
to dominate X when we have more than two populations.. A class of ! 
estimators dominating X was obtained also by Khatri and Shah (197 4), 

Norwood and Hinkelmann (1977) considered estimation of the [ 

■ 1 

common mean p. of k normal populations with unknown and unequal I 

2 2 — 

variances ..., 0 ^^. Let X^ and S^ be the mean and siom of squares 

t h ' 

respectively from the i sample. Norwood and Hinkelmann showed ! 

A 

that an extension of the Graybill Deal estimator Pqq* 
k 

n _ .4 ~ ^ 

^NH “ k 
. L = 1 

is better than each X^, if each sample size is more than 10 or, 
if one sample size is 10 and all others are more than 18. 

Shinozaki (1978) and Bhattacharyya (1979) proved that the 


estimator 
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^3B “ k 


- 1 - 

S C, S, -"x, 

. . 1 i 1 

1 = 1 


s c. s . ^ 
. - 11 
1=1 


where ' s are constants, is better than each if and only if 
(m^ + 1) 2(m^-5) 

2im^-5) - c“ - ~Tm 7 TlY ' 1 = 1 ,... ,k-l. 


with as the i^^ sample size. 

Bhattacharyya Cl984) showed that the left part of the abovei 
inequality is unnecessary. For a proof of this fact he developed [ 
two general inequalities. 

Sinha and Mouqadem (1982) investigated admissibility of S 
the Graybill-Deal estimator when k = 2. considered four 

classes of unbiased estimators ! 

X = {M: a = X + (Y-X)^ , 0 < 'f (S^,S2,D^) < 1 } , 

= (p: M = X + (Y-X)’? , 0 < 'ifCs^/S^) < 1 } , 


= {p: M = X + (Y-X)'if , 0 < f (S^, S 2 ) < 1 } and 


= 


'i, 2 


~ 2 \ 


2 = {p: M = X + (Y-X)'? , 0 < '{'CS^(Y-X) ^ S2(Y-X) < 1} . 


It was shown that is admissible in extended admissible in 

'jJU o 

'C but neither Bayes nor limiting Bayes in C 2 . Some estimators 
admissible in classes and C 2 were given. 

Bhattacharyya (1980), Kubokawa ( 1987a, 1987b) have also 

obtained classes of estimators dominating X. Kubokawa ( 1987b) 
develops admissible estimators from these classes of estimators. 
Kubokawa (i987c) has generalized the result ‘of Bhattacharyya (1984) 
to a class of more general loss functions w(lp-pl^), where W is a 
concave function and 0 < r < 2. 
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Shinozaki (1973) has also considered the estimation of the 
common mean vector of k p- variate normal populations. He gave a 
class of unbiased estimators which, for any p, dominate each of the 
k sample means. However, these unbiased estimators can also be 
improved by biased estimators for p ^ 3. 

Hogg (1960b) vas the first one to consider the general 
problem of estimating the common location parameter of several 

populations vAnich have the same form of the density but different l 

■ \ 

sccde parameters. He suggested a method of constructing unbiased i 

i 

estimators.- The method used the fact that if the density under 1 

t 

I 

consideration is symmetric about the location, the conditional 
expectation of an odd location- scale statistic given an even loca- i 
tion free- scale statistic equals the location parameter. A statistij 
is said to be odd location- scale if it is equi variant under affine | 

group of transformations {g’. gx = ax+3, a real and 0 / 0}. An even ‘ 

i 

location free- scale statistic is one invariant under translation i 
and equi variant under scalar multiplication. Combining odd loca- 
tion-scale estimators from the. samples with the weights as func- I 
tions of even location free-scale statistics, he obtained an unbiased; 
estimator of the common location parameter. 

Cohen (1976) gave examples of where the problem of esti- 

I 

mating a common location for two populations could arise. He i 

obtained a combined estimator d, vhich is unbiased and which, for 

. cL 

0 < a jC a (ra, n) ; m,n the sizes of the sample from two populations, 
improves upon the first sample estimator under mild conditions. 

Bhatt acharyya ( 1981) ' Showed that Cohen's estimator 6^ 
improves upon the estimator 'i , if 0 < a A(m, n). The bound A(m, n) 
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is shown to be larger than a (m,n) and easier to calculate. In 
for uniform distribution tabulated values show that a* (m, n) is ne^ 
larger than 1 for both the pairs (m, n) and (n,m) vAiereas A(m^n) _> 
for both the pairs (m, n) and (n,m) for m = n > 25 and for n > 35 
whenever m _< n+5. As will be seen later in Chapter 6 , if the boun 
is greater than or equal to 1 for both the pairs (m, n) and (n,m) , 
the estimator 5 . is better than both ^ and , the estimators fro; 

the two samples. ' 

■ i 

Akai (1982) modified the estimator 6 and obtained suffi- 

^ i 

cient conditions for it to dominate '{f and 'f . 

X y 

So far in this section, we have restricted attention to th( 
case, where the samples come from independent populations. Halperj 
(1961) was probably the first one to consider the estimation of the 
common mean of a general multivariate normal distribution. He obtc 

I 

ined the maximum likelihood estimator (MLE) and showed that its i 
variance is equal to that of the minimum variance linear unbiased 
estimator except for a multiplicative factor vAiich does not depend 

I 

on the parameters and approaches unity as the sample size becomes 

i 

large. It is interesting to note that when the correlations are 1 , 
assumed to be zero, that is, in the case of independent populations 
the MLE cannot be obtained explicitly and so has not been considere 
by authors. 

Rastogi and Rohatgi (197 4) considered the above estimation 
problem for a bivariate normal distribution. Let (X^^, Y^^) , . . . (X^, 
be a random sample from a bivariate normal pop-ulation vdth common ; 

2 ' 2 2 2 ' ‘ i 

mean m» Var(X^) = a Var(Y^) = o jL and the correlation 

coefficient p. They evaluated the variance expressions of the two I 

. A. - ^ , 

estimators and where 


A 


V j-V 
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is the average of tvv-o sample means and 

A — __ 

M = Y + (x-Y) — r 

2 ^ 22 "^ 12 ^ 

is the tiLE, ^22 components of the sample 

covariance matrix. Numerical computations show that as n becomes 
large t:he ratio Var(p^)/Var(P 2 ^ tends to be larger than 1 except 

2 2 ^ A 

for a-, = Oa* In general, for fixed p, the ratio Var (p. ) /Var (m„) 


.2 /^2 


decreases as Increases to one and for fixed it 

increases as p increases in absolute value. Rastogi and Rohatgi 
also considered the case when additional N-n observations are 
available on X variable. Such a situation arises, for example, 
when two measuring devices are used to obtain readings on each of 
a number of objects or units and one of the measuring devices 
stops functioning after taking some readings. Two alternative 


estimators were suggested for this case and their performances j 

■/N ■ 

compared numerically with that of <^ne of the estimators Z is : 

A. 

a convex combination of average of the last (N-n) 

observations on X with weights n/N and (N-n)/N. Z is seen to ! 

perform better than ^2 most part of the parameter space. ! 

' ■ ' i 

Recentlv Krishnamoorthv and Rohatgi (1988a) have proposed 1 

i 

estimators ^2 ^4 the common mean of a bivariate normal | 

distribution) and compared their risk performances numerically i 

A A , 

with that of ^ 2 * ^2 Is seen to perform satisfactorily. ! 

Glesser (1987a, 1937b) and Krishnamoorthy and Rohatgi (1988b 

have considered the problem of estimating the mean response vAien the 
control variables are used. By making a linear transformation 
this problem is seen to be equivalent to that of estimating the 
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common mean. Glesser obtained the MLE and proposed a class of 
unbiased estimators dominating it. Krishnamoorthy and Rohatgi 
(1988b) have suggested another unbiased estimator which dominates 
the MLE over a large portion of the parameter space. 

In this thesis we take up some of the problems discussed 
above. A suntnary of the results obtained is given in next section. 


1. 2 Summary of the Results in the Thesis 

In Chapters 3 and 4. we take up the problem, discussed in 
Section 1. 1. 1, of estimating ordered parameters when the ordering 
is known. Let ^ ^ random sample from a continuous 

population with the density f^^Cx-©^), i = l,...,k. It is assumed 
that the k samples are drawn independently. We take 

OO 

/ X f . (x) dx = 0 , i = 1, . . . ,k 


without loss of generality. Algo, let ©^'s be ordered, say 
1 — 2 — — k 

In Chapter 3, the problem of simultaneous estimation of 
0 = (0^,...,0^), vben the loss function is squared error, that is, 

k 


L^(0,a) = l©-a 1^ = E ^ ) 

i = l 


( 1 . 2 . 1 ) 


is considered. VJhen the parameter space is R , the most commonly 
used estimator of © is the Pitman estimator X = (X^, . . . , , wtiere 


n 


; 9^ TT fpx,j-e^)de 


1=1 


i. OO n 

/ T7 f-. (X, ,-©, ) d©.. 


i = 1, . , . ,k . 


( 1 . 2 . 2 ) 


1 ij 1' 


-OO j =1 

Eor ©. 's ordered, an estimator of interest is 5, the 

' * '■ ' hr 

analogue of the Pitman estimator X. It is defined to be the 
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generalized Bayes estimator of 9 with respect to the uniform prior 
on the space {9: 9. 9, ]. If the components of 6 are 

J. A. "“"P 

denoted by . . - / respectively, we have 


*^pr ^^11' ‘ 


\n^ = 


/ • ♦ • / 

G^<. . . i = l j=l ^ 


k n 

T7 n f, (X, ,-9,)d9 


IJ 


1 • 


d©. 


k n 

/ / TT IT f. (X -9 )d9....d9, 

i = l j=l ^ ^ ^ 


X / • • « / Ic • 


(1. 2. 3) 


Hereafter, 6 will be simply called the Pitman estimator of 9. • 

Bliimenthal and Cohen (1968b) considered k = 2 and identical 

2 

f^'s. VJhen the parameter space is any siibset of R , not neces- 
sarily [9: 0^ _< 02 3/ they proved under a mild condition on that 
any estimator, with the risk function noir than the constant 

risk of the estimator X for all parameter values in S^, is minimax 
for 9, 9 G E^. In particular, the condition is satisfied vAien the 
parameter space is {9: 9^ _< Section 3.2, extend this 

result to a general k and nonidentical f^^'s. A simple corollary 

of this resiilt is that the usual estimator X remains minimax \*iien 

k • 

0 is restricted to a subspace of R . We also give a similar 

result for the problem of estimating a component 9^ of 9 vhen the 

loss function is squared error. 

In Section 3. 3, we take k = 2 and f^ as N(0^,l), i = 1,2; 

The properties of the mixed estimator 6 (X) given by 

13 ql 


^ _^(X) = (cxX^ + (l-a)X 2 , (l-a)Xj^ + 0X2) ; 

where a = 1 vhen X^ _< X 2 

+ . 4 - 

= a vben > X 2 , a a constant. 
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are investigated. We show that 0 j< a"^ < 1, dominates X 

a 

and so is minimax. A class of estimators admissible among the 
mixed estimators is obtained. Another class of minimax estimators 
is also given. It is proved that the mixed estimator 
the best choice in this class. vJe, however, show that any mixed 
estimator is inadmissible. The proof uses the fact that the class 


of generalized Bayes estimators is complete. We prove that ^ is 

a'*' 

not generalized Bayes and so is inadmissible. However, this 
method of proving inadmissibility does not yield a better estimator. 


We do not know vhat estimators will improve d 


finally, a com- 


parison between the Pitman estimator 6 and the mixed estimator 

P 

— 1/2 made. 

In Section 3. 4, we study the case of two normal poptdations 

with unequal but known variances. As before, the MLE and the mixed 

'4* 

estimators d ^(X) / 0 _< a < .1, dominate X and thus, are minimax. 
a 

However, unlike the equal variances case, the MLE, here, improves 
some of the mixed estimators including The Pitman esti- 

mator d , as mentioned by Cohen and Sackrowitz (197 0), is admiss- 
P 

ible. We prove that it is minimax. We also compare the risk 


function of d with that of the MLE and of the mixed estimator 

ot) serve that ^ does not improve any. 

The problem of Section 3. 4 is a special case of the i 

. x^-0- . x^-©^ ! 

densities f( — g — -) and ~ f < ^ 2 ' ^ihh and CJ^ ; 

unequal but known. In Section 3. 5, we consider a still more I 

general problem of estimating location parameters and ©2 of ! 

densities f^^Cx^-©^) and f 2 (x 2 -© 2 )* — ^2' f ' s may be 

different, and obtain sufficient conditions for the minimaxity of j 

the Pitman estimator defined by (1.2.3). This is a generalization 

hr . ^ [i 
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of the results of Biumenthal and Cohen (1968b) v^o considered 
densities f(x^-©j^) and f(x2-92^' S ® 2 ‘ of the sufficient 

conditions for minimaxity is the monotonicity of certain ratios 
of the distribution function and the corresponding density. It 
is seen to be satisfied for normal, uniform and gamma distributions. 

The results of Chapter 3 are due to appear in Kumar and 
Sharma (1988) under the title "Simultaneous Estimation of Ordered 
Parameters". ■ 

In Chapter 4, we consider k, independent normal random 
variables with means 0^,...,©^ respectively, ©^ 

and the common variance unity. For estimating © = (©^,...,9^), 
when the loss function is (1.2. 1), we show that the Pitman estimator 
is minimax. The proof makes use of an identity due to Stein ■ 

(1973). The identity has been used by Stein and others for | 

finding an unbiased estimator of the risk difference. We also 
introduce mixed estimators for a general k. However, the form of 
the estimator is complicated even for k = 3. 

A result of Brown (1971) proves that ^ is inadmissible 
for k > 3. However, he does not give any dominating estimator. 

For k = 3 we propose some alternative estimators which may possibly ‘i 

improve 6 . These estimators are obtained using Brown's (1979) i 

P I 

technique and through empirical Bayes considerations. The risk | 

t 

functions of the proposed estimators are too complicated for making . 

■ ' I 

any theoretical comparisons. We also use the Brewster- Zidek (197 4) 

[ 

technique to prove admissibility of 6 among its multiples and I 

Ir "'.I 

obtain a necessary and sufficient condition for its admissibility ; 
in another class of estimators. i 
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In Section 4.3, we consider the estimation of the compo- 
nents of 0. When we have two normal populations with means 
and © 2 ' unequal known variances, Cohen and Sackrowdtz 

(1970) proved that the component 6 ^ of 5 for estimating 0„ is 
minimax with respect to the squared error loss. However, the 
situation is different when we have three normal populations with 
means 0^' ®2 ^3' — ®2 — ^3 equal known variances. We 

show that the components ^ estimating 

©2 respectively are not minimax. We have not been able to prove I 
or disprove the minimaxity of 6^2 an estimator of © 2 . I 

Finally, we consider the estimation of the larger of two | 

■ I 

location parameters in the set up given belowi | 

Let and X 2 be two independent random variables with the i 
densities f (x-©^) and f (x-© 2 ) respectively, ©^ < 9^ and also let f | 

I: 

be symmetric about zero. Let 6 (X 2 ) = + a(X 2 ) be an estimator | 

i: 

of ©2 with a(X 2 ) bounded above. We prove the inadmissibility of | 
6 (X 2 ) when the loss function is strictly convex. The result is a ! 

t 

generalization of Theorems 2.1 and 5.1 of Cohen and Sackrowitz (197 0 

i 

In Chapter 5, the general problem of estimation is consi- 
dered. Let the underlying family of probability distributions be 
absolutely continuous with respect to a CJ- finite measure M and 
the loss function be quadratic. Suppose the estimation problem is 
invariant under a finite group G of transformations viiich preserve | 

rvj' 

p and the induced group G be a commutative subgroup of the group 
of linear transformations. Moors (1981, 1985) obtained a suffi- 

cient condition for the inadmissibility of G-equi variant estimators. 
In a sijbsequent paper. Moors and Van Houwelingen (1987) showed that 



24 


the conditions that g t G preserve m and that G be commutative can 
be relaxed. In Section 5. 2, we consider a more general set up of 
any locally compact group with G a subgroup of the affine group 
and the loss function any strictly increasing function of the 
Euclidean distance between the estimate and the estimand. We 
obtain sufficient conditions for the inadmissibility of G-equi- 
variant estimators. The conditions that G be commutative and 
g 6 G be measurepreserving, shown to be redundant by Moors and 
Van Houwel ingen (1987) for finite groups, seem to be necessary in 
the general set up. 

In Section 5. 3, some applications of the inadmissibility ; 

restilt are given. In particular, we consider the estimation of 

■ 

two or more ordered normal means and the estimation of two ordered 
binomial probabilities of success vAien the loss function is quad- i 
ratic. We also consider the estimation of normal mean and | 

binomial probability of success vAien these parameters are rest- | 

' ! 

ricted to the bounded subsets of the natural parameter space and | 
the loss function is quartic. 

I 

I 

Chapter 6 deals with the problem of estimating the common | 
location of two populations which have unequal and unknown scale 

! 

parameters. An account of earlier work on this problem was given 
in Section 1.1.2. Let X = (X^, . . . , X^) and Y = (Y^, ,..,Y^) be 
independent random samples from populations with the densities 
— f (— — ■) and ~ f (-^— ) respectively, where and o are unknown 

°x X y y ^ 

and possibly unequal. The density f is assumed to be an even 
function and the loss function squared error. Let 7? and t be odd 
location- scale and even location free scale estimators of © and 
respectively based on X. Similarly, let f and be defined 

y y 
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for Y. Cohen (1976) considered improving 'if and suggested an 
unbiased estimator 6 ^t 

V a. 


_ ( 1 _ — — ) W + — w 

1+Z^ -X 1+Z 


( 1 . 2 . 5 ) 


2 2 

where Z = and a is a positive real. He obtained an upper- 

bound a (m, n) for a such that for 0 < a < a (m, n), 6 dominates 

3 l ' , 

. Bhattacharyya (1981) enlarged the class of estimators <5 

X ql 

dominating by finding a larger upperbound A(m, n) on a, that is/ 
A(m, n) is such that for 0 < a _< A (m. n), the estimator 6 improves '? 

3 l yi 

We, in Section 6 . 3, develop sufficient conditions vhich 

I 

i 

provide bounds different from those of Cohen and Bhattacharyya. | 

The bound in Theorem 6.3.2 is sharper than A(m, n) and thus results 

in a larger class of estimators 6 ^ dominating Also the bound 

■ 

is easier to calculate than A(m,n). The bound in Theorem 6.3. 1 is i' 

not always larger than A(m, n), however, its calculation is much ■ 

easier. We apply Theorems 6.3. 1 and 6.3.2 to the uniform distri- | 

but ion and obtain bounds B^(m,n) and B^(m,n) respectively. It is 

seen that B^(m,n) is not always larger than A(m,n) but B^(m,n) is 

never less than A(m,n) for any values of m and n. In fact, B^(m,n) 

> 1 for both pairs (m,n) and (n,m) vhen m = n _> 20 and also vhen 

n _> 32 if m _< n+5 compared to A(m,n) _> 1 for both pairs (m, n) and 

(n,m) when m = n > 25 and \-Aien n > 35 if m ;< n+5. As pointed out 

in Section 1.1.2, if the bound is greater than or equal to 1 for 

both pairs (m, n) and (n,m) , the estimator 5 ^^, for a = 1 , is better 

than both 'F and 'F . 

^ y 
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In Section 6,4a different combined estimator of 9 is 
considered: 


5c = '•'x + «2 

cr:2 


where = 


- 3-2 and W 2 = 1-W^. 


( 1 . 2 . 6 ) 


We develop sufficient condi- 


_ 2 

+ r 

X y 

tions for 5 to improve 'if , Using a symmetry argument the classes 

of estimators dominating both and are obtained. 

X y 

In Section 6 . 6 , we consider improving the Graybill-Deal 
estimator for estimating the common mean p. of two normal dis- 

tributions with unknown and unequal variances. Sinha and Mouqadom 
(198 2) investigated admissibility of in certain subclasses of 

■e»{p: p = X-*-D '?(S^,S 2 /D ), 0 < f < 1], where D *. y-JC They 
also gave a simplified expression for the risk function of an 

A 

estimator p c o . We restrict attention to a subclass = 

{p: p = X + D 'F(Sj^,S 2 ), 0 < ^ of ^ and obtain a differential 

inequality. A solution of the differential inequality would 

A 

provide an improvement over p^^^ in We have not been able to 

prove the existence of a solution and the question of inadmissi- 
bility of Pqj^ is still open. 

In Section 6.7, the problem of estimating the common mean 
of a bivariate normal population with unknown correlation p is 
taken up. Krishneimoorthy and Rohatgi (1988a) proposed an estimator i 

A • 

P 2 and obtained the region of the parameter space vhere it dominate^ 
the MLE P 2 * They also compared the risk performances of P 2 and p^ 

We consider some modifications of p^ v^ich have larger region of 

A , A ■ 

dominance over M 2 than These modified estimators belong to a 
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larger class of estimators , c real]. We obtain minimal 

essentially complete class of estimators in the class. Finally 
the risk performances of some of these estimators are compared 

A. , A 

nijmerically with those or p.2 
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CHAPTER - 2 

Basic Definitions and Results 

In this chapter we give some basic definitions and 
results which will be used subsequently. For more details one 
can see Ferguson (1967)/ Lehmann (1983) and Berger (1985). 

, Let X be a random observable (usually a vector) with values 
in a space , and have a distribution P^, 9 belonging to the para- 
meter space Q. The parameter © is unknown but Q is ass\med to be 
known. The problem is of estimating a measurable function h(9) 
of 9. We assume that the estimates lie in a space , which is 
the convex closure of h(Q) « {h(©): © 6 Q]. ^ is also called the 
action space of the estimation problem. 

Let 6(X) be an estimator of h(©).i When X = x is observed, 
the loss incurred in estimating h(©) by 6 is L(©, i5(x) ) , a real 
valued, nonnegative and measurable function in both its arguments. 
We assume L(©,h(©)) = 0, that is, the loss is zero .whenever correct 
value is estimated. 

The loss function L (©, a) is said to be convex (strictly 
convex), if it is a convex (strictly convex) function of a. 

Usually, the loss function is taken to be an increasing function of 
the Euclidean distance th(0)-6(x)l between the estimate and the 
estimand. Two commonly used loss functions are 

L^(©,a) = l©-al^ , (2.1) 

( 2 . 2 ) 


and L'(© , a) = 10- a I 
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called the squared error loss function and the absolute error loss 
function respectively. 

The perfoinnance of an estimator 6(X) is measxared by the 
risk function 

R(e, 6) = Eq L (e, 6(X) ). 

vdiere Eg denotes the expectation when the true probability distri- 
bution is Pq. 

Ideally one would like to have a 6 which has minimum value 
of R(6,6) for all 0 £ Q. However, this is possible only when h(0) 
is a constant or q is a singleton, both the cases being of no 
interest. 

An estimator 6^(X) is said to be better than 6j^(X) if 
RCe.d^) < R(0,6^) for all © e Q , 

and R(©', 6^) < R(0', 6^) for some 0' £ Q . 

Equivalently, we say that 6^ improves 6^ or 6^ dominates 6^^, 

The estimator 6 q is said to be as good as 6^ if 

- R(e,6^) for all 0 t Q. 

Let the class of all the estimators be denoted hy and 
^ be a sxibclass of . An estimator 6^ is said to be admissible 
in the class C. , if 

R(©,6) < R(e,6^) for all 0 £ Q and any 6 £ {" 

R(©,6) = R{0,6^) for all 0 £ Q. 

Alternatively, 6^ is admissible in ^ , if there is no estimator in 
^ better than 6^. An estimator admissible in ^ will simply be 


called admissible. 
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If an estimator is not admissible, it is said to be inad- 
missible. Thus, if Sq is sin inadmissible estimator, we can find a 
better than 6^. 

A subclass 'C of 0 & is said to be complete (essentially 
complete) if for any 6^ not in C , we can find a 6^ in which is 
better than (as good as) We call "C* a minimal complete (mini- 

mail essentially complete) class, if "C* is complete (essentially 
complete) and no subclass of 'C is complete (essentially complete). 
If, in an estimation problem, a minimal complete class exists, it 
is the class of all the admissible estimators. 

The advantage of having a complete (essentially complete) 
class is that we need not look outside it to find an estimator, for 
we have a better (as good as) estimator in it. 

When the loss function is convex, the class D of adl non- 
randomized estimators is essentially complete in , (For a defi- 
nition of the randomized estimators, see Ferguson (1967).) Further, 
if a sufficient statistic T exists, then the class of all non- 
randomized estimators based on T is essentially complete. 

An estimator 6 is said to be minimax if 
o 

Sw R(©, 6^) = Inf Sup R(0,6) . (2.3) 

G r Q ° e e 0 

The value on the right hand side of (2. 3) is called the minimax 
risk or the upper value of the estimation problem. 

Let (Sl(q) be a o- field of subsets of Q. A measure t on 
(o, (&.(q) ) is said to be a proper prior if Tt(Q) < <». 


If 7l(Q) 


«> with 
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/ Pq(x) d7l(0) < CO for almost all x (a. e. [m]) , (2.4) 

Q 

where is the density of Pq(x) with respect to a o-finite 

measure p on ( ^, (^(^)) and (^(■^) a o-field of subsets of ^ } 

■n is called an improper prior on 0 . 

The posterior or formal posterior distribution of Q ■ 

given x is p_(x) du(0)// p^. Cx) dic(9) according as the prior ' 

^ Q 

measure u is proper or improper. The corresponding posterior 
or formal posterior risk of 6 is 

/ L(e, 6 (x)) P 0 (x) du(9) / / Pq(x) dH (0) . ! 

Q Q 

An estimator 6 ^ minimizing the posterior risk (formal post- i 
erior risk), or equivalently, ^ L(e, 5 (x)) P 0 (x) dii{9) is called i 
a Bayes (formal Bayes or generalized Bayes) estimator with respect j 

to It. When Tiio) < oo , 5^ also minimizes the Bayes risk defined by j 

{ 

r(7i, 6) = / R(e,5) d7i(0) . ! 

Q , 

. , . t 

When the loss function is squared error, the Bayes esti- 
mator is the mean of the posterior distribution and when the loss 

I 

is absolute error, the Bayes estimator is the median of the post- 
erior distribution. 

Let e > 0. An estimator 6 is said to be e -Bayes with j 

' o 

respect to tc, if 

r(ii, 5 ,.) < inf rill, 6 ) + e . ■ . 

“ 6 e-Q- 

An estimator 6 is extended Bayes, if for any e, > 0, there 

o ■ ' ’ ■\ 

is a prior such that 6 ^ is c-Bayes with respect to 
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"ic 

Let Q be the class of all prior distributions on Q, A 

"'Ac 

prior distribution 7 ; is said to be least favourable, if 

Inf r(t*, 6) = Sup Inf .r(7X,6) . (2.5) 

6 . 71 e Q* 5 e ^ 

Thus, a least favourable prior maximizes the mi nimxjum Bayes risk. 

The expression on the right hand side of (2.5) is called the lower 
value of the estimation problem. It is always less than or equal 
to the upper value of (2.3). When the two are equal, the common 
value is called the (minimax) value of the problem. In Theorem 2. 1 
below, we state the conditions for an estimation problem to have a 
value. We need the notion of a lower semi continuous function. A 
real valued function f is said to be lower semi continuous, if for 
each c £ R^, the set {x: f(x) > c } is open. 

Theorem 2,1 (Ferguson (1967, p, 85)) : Let ^ ^ be an essenti- 

ally complete class. Assume that there is a topology on ^ such 
that C is compact and R(0,6) is lower semi continuous in <5 £ C 
for all 9 £ n. Then the estimation problem has a value and a 
minimax estimator exists. 

In the problems with a value, we expect the Bayes estimator 
with respect to the least favourable prior to be minimax as well. 
This is seen to be tirue in general as stated below. 

Theorem 2. 2 : Assxime that the estimation problem has a value ai7d 

that a minimax estimator exists as well as a least favovirable prior 

★ ^ ■ '★ ■ 

71 . If < 5 ^ is the unique Bayes estimator with respect to 7 ; , then 

is minimax, 

O ■ ; ' . ' 
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Another optimality criterion, sometimes used, is that of 

-minimaxity. Let ^ be a subclass of q* . An estimator 6 is 

o 

said to be ^ -minimax if 


Tl 




r 


Inf Sup r(t,6) . 

6 It £ ^ 


An ^-minimax estimator ’ reduces to a Bayes estimator in case ^ is 
singleton and to a minimax estimator if ^ is the vdiole of Q*. 

Next, we introduce invariance in estimation problems: 

Let G denote a group of measureible transformations f rom 
into itself. The group operation is composition: if g^ and 
are transformations from 35 into itself, 92^1 defined as the 
transformation x -• g2(92^^^^* 

The family (p = {PqJ 9 £ Q } of probability distributions on 
is said to be invariant under G, if for every g £ G 
and every 0 £ Q, there exists a unique ©' such that the distribu- 
tion of g(X) is given by P^, whenever the distribution of X is 
given by Pq. The 0' uniquely determined by g and 0 is denoted by 
g(0). The set G * {g: g £ G } is a group of transformations from 

Q into itself. It is seen that G is a homomorphic image of G. 

A loss function L (0,a) is said to be invariant TiiKler G, if 
for every g £ G and a £ there exists an a' ^ such that 

L(0,a) =L(g{e),a*) for all ©£ Q . 

Without loss of generality a' can be chosen to be unique so that 

given a g it is a function of a. We denote a' by g{a). The set 

G = {g- 9 £ G } is again a group of transformations from A into 
itself and also it is homomorphic image of G and G. 


i 

i 
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We call an estimation problem G-invariant, if the family 
of probability distributions 6^ and the loss function L(e,a) are 
invariant under G. 

For a G-invariant problem, an estimator 6 £ D is said to 
G-equi variant, if 

5(g(x)) = g(6(x)) for all x £ 56: and g £g . 

Tvjo points ©2 and ©2 Q said to be equivalent, if 

there exists a g £ G such that 6^^ « g(02). This is an equivalence 
relation and the equivalence classes introduced by it are termed 
orbits of 0 under G. A significant result is that a G-equi variant 
estimator has constant risk function on the orbits of 0. Thus, in 
the problems where G is a transitive group, the risk of a G-equi- 
variant estimator is independent of the parameter. 

It is interesting to investigate the situations in viiich 
an estimator miniraax among G-equi variant estimators is minimax 
among all the estimators. Kiefer (1957) obtained sufficient condi- 
tions for such a result to hold. The conditions imposed are both 
on the loss function and the group G of transformations. These 
conditions and the result are also discussed in Eaton (1966). 

An application of Kiefer' s theorem proves the minimaxity 
of the best translation equi variant estimator in estimation of a 
location vector. 

Theorem 2.3 : Let independent and identically distri- 

buted random variables with probability density f(x-0) on R^, 
where 0 £ R^. If E I 1 ■ < “, i = 1, . , . , nf then the best transla- 
tion equi variant estimator of 6 is minimax when the loss function 
is squared error. 
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In the set up of Theorem 2. 3, consider estimation of a 
component of 9, i = l»«..i|p. It can be shown that for this 
problon also Kiefer's result is applicable and so we have the 
following result. 

Theorem 2.4 ; In the set up of Theorem 2.3, the component of the 
best translation equi variant estimator for estimating 0^; i = 
l,...,p, is minimax vhen the loss function is squared error. 

Theorems 2. 3 and 2. 4 are used to prove general minimaxity 

' li 

results for the problem of estimating ordered location parameters 

(! 

considered in Chapter 3. i 

I 

When the group G is compact, we can restrict attention to 

I 

the class of G-equi variant estimators for proving admissibility or 
inadmissibility of G-equivari ant estimators. Blackwell and s 

Girshick (1954) and Savage (1954) originally proved this result | 

I 

for finite groups. The result in its generality, as stated below, : 
was proved by Stein (1956). 

1 

Theorem 2.5 : Let an estimation problem be invariant under a ; 

I 

compact group G of transfoirmations. Let 6^ be a G-equi variant 
admissible estimator and for any 6]^ satisfying 

R(e, 6^) < R(©, 6^) for all 0 £ D, 

j 

R(g( 0 ), 62 ^ continuous function of g for each 9. Then 5^ is 

an admissible estimator. 

In Chapter 5, we consider G-equi variant estimation problems 
for specific distributions, -when the group G is finite or compact. 

For each observed x, a subspace A of the action space is obtained 
such that a G-equi variant estimator 6(X) , not taking values in 
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with positive probability for some 0 G Q, is inadmissible. Thus, 
a G-equi variant admissible estimator, and so admissible by Theorem 
2.5,. must necessarily lie inside with probability one. 

Consider an estimation problem invariant under a group G 
of transformations. We are interested in finding an optimal G- 
equi variant estimator. Let T be a minimal sufficient statistic for 
Q. It is a common practice to restrict attention to nonrandomized 
G-equi variant estimators based on T alone. Sharma (1983) proved 
under fairly general conditions that there is no loss of generality 
in this approach. Specifically, the question is the following: 

Is, D.p, the class of all nonrandomized G-equi variant estimators 
based on T, essentially complete in the class of all nonrandom- 

ized G-equi variant estimators? As an example, we consider the 
problem of estimating the common mean of two different normal 
popxilations: 

Let X = (X^,...,X^) and Y = (Y^, ...,Y^) be independent 

2 2 

random samples from N(p,o^) and popxilations respectively. 

2 2 

The variances and are assximed to be unequeil and unknown. 
Consider estimation of M when the loss is 

1^2 (A/M) “ (m-m) 1 . 

Let G be the affine group of transformations, that is, under G, 

X, - aX. +b, i = 1,. ..,m; Y. - aY. +b, j = 1,... ,n; a and b are real 

X 1 J J 

2 2 2 2 2 2 

and a / 0. Then (pL,o ^,a -* (aji+b, a a estimation 

problem is invariant under G. The loss function is convex and the 
minimal sufficient statistic T = (X, Y, S^, S 2 ) is G-equi variant. 


that is; 



37 


T(X 


1 ' 


X 


m 


■ 1 ' 


Y^) = T(X‘^, 


m' 


Y' 

^1' 


/Y') 
' n 


ai- T(aX^+b, .. . ^aX^+b, aY^+b, . . . , aY^+b) 

= T (aX^+b, . , . , aX^+b, aY^+b, . , , , aY^+b) , . 

Now, the question is, can we, without any loss, base our nonrandom- 
ized G-equi variant estimators only on T? The result of Sharma 
(1983, Theorem 3,2) answers this question in the affirmative, 
since an affine transformation involves only arithmetic operations. 

In Chapter 5, we use Haar measure to obtain an essentially 
complete class of G-equi variant estimators in the problem of esti- 
mating two normal means when there are no restrictions on the 
parameter space. We briefly describe below a Haar measure (for 
details see Halmos (195 2)). 

Consider a topological group G, that is, a group which is 
a Hausdorff space and the mapping of GxG into G, defined by 

~ ^1 ^2* continuous. Let G be locally compact and let 
(SlCg) be a class of subsets of G, A left invariant Haar measure 
is a o-finite measure on (g, 6^(G) ) satisfying 
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of G and xinique upto a positive constant of proportionality (see 
Halmos (1952, p. 254)). 

In Chapter 5, we consider Haar measure on the orthogonal 
group, that is, X rx, r an orthogonail matrix. A brief descrip- 
tion of this is given below (see Lehmann (1959, p, 335)): 

Consider the group G of ksdc orthogonal matrices, with the 

matrix product as the binary operation. G can be thought of 

2 

as a subset of k -dimensional Euclidean space R , by representing 

k^ 

a matrix as a point in R . Take a class of Borel subsets of G 
as the a- field ()^(G) , Now, G being a compact group, there exists 
a right invariant probability measure v on (G, (2r(G) ) satisfying 

v(Br) = v(B) for all B G QiiG) and r G G. 


The measure v can be constructed as follows: 

Let X = (Xj^j) be a kxk random matrix with i nd epend ent 1 y 

and identically distributed N(0,1) random variables. The distribu- 
tions of Xr' and X are the same for any orthogonal matrix T'. By 
an application of Grara-Schmidt orthogonal! zation process, we can, 
for each X, find an oirthogonal matrix Y = f (X) such that YT' = 
f(Xf'). Now the distribution of Y and Y r* are the same and so the 
probability distribution v of the random matrix Y is clearly 
orthogonal invariant. 
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Next, we describe some techniques for proving inadmissi- 
bility of estimators. 

The Brewster- Zidek Technique 

A usefiil technique for improving upon equi variant estimators 
was developed by Brewster and Zidek (197 4). However, the method as 
such can be used in general. Suppose we want to improve an estima- i 

i 

tor 6 . Consider a class ^ of estimators of vjhich is a member. ; 

Let 6 0 be the optimal choice in £ for each 9. A suitable choice i 

of ^ may render 6 ^ independent of 0. For example, in the problem 

2 

of estimating the variance a of a no rmeil population with unknown ; 
mean p, based on a random sample X^,...,X^, the maximxira likelihood 
estimator S /n is improved by S / (n+1) , the best choice in the class 

! 

{cS^: c > 0}. I 

Sometimes it is difficxilt to choose a 'C such that 6 q is 

independent of 9. Improvements are still possible, if 5 does not 

o 

vary significantly with 9, but is quite different from 6 . 

Consider a class = { 6 _* c real } of viiich 6 ° is a member, say 

A ^ I 

with c s= c . Find c^, the choice of c minimizing R(0,6 ) for I 

O o ^ c 

each 9. If R(9, 6 ) is a strictly convex function of c, improve- 

o 

Q ^ mm A 

ment over 6 is possible provided c * Inf Cq > c^or c = Sup Cq < < 

The dominating estimator is 6 or 6 according as the first or 

— c 

second inequality holds. Further, the class { 6 ^: c jc c ^ c 1 is | 
minimal complete in 

This method can be generalized to cases; vhere we consider 

classes of estimators characterized by two or more constants. As 

' ' '■ ' ■■ ■' , ■ '■ ■ ' 

an example, consider estimators of the form 6 ^ where (c,d) = 

gives 6 °. Assume that the risk function R(9, is 



stric±.ly bowl- shaped (see Brewster and Zidek (197 4 ) for a defini- 

tion) and that and d^ minimizing R(0,6^ for each 0 can be 

obtained ej^licitly. Call c = Inf c^, c = Sup c„, d = Inf 
A ©Go 0 G g 9 t Q 

and d = Sup d^. Then an estimator dominating 5 can be obtained 

e e 0 

if c > Cq, d > d^ or c < c^ and d < d^. 

The orbit by orbit improvement technique of Brewster and 
Zidek involves reducing the risk of an equi variant estimator on 
the orbits of some invariant statistic Z, usually taken to be a 
maximal invariant. Consider estimators of the form 
f gives 6°. Define the conditional risk function of 6 


fCz) 


given Z = z as 


R(©/ 6 ^(^)) ^ \ Z = z3 . 


Assume that ^ strictly convex function of Y(z) and 

A. 

that Yq ( z) minimizes R(©, 6 ^ ^^j) for each 6 and z. Identify the 
sets 

A = {z: 'f(z) = Inf ? ^ ( z) > 'F„(z) ] 

9 G Q ° 

and B = fz: i( z) = Sup ? . ( z) < f (z)} . 

e G Q ® ° 

Then the estimator 6 * * vdiere 

(Z) 

^* ( z) = ( z) / if z G A 

= ’?( z) / if z G B 

= f°(z) elsev^ere, 

dominates 6 ^ provided Pq (A \J B) > 0 for some 9 G Q, 

Brown* s Heuristic Approach 

Brown (1979) developed a heuristic method for proving 
admissibility or inadmissibility of estimators. He reduced the 


P^> 
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question of admissibility to the problem of finding solutions of 

certain differential inequalities. The coefficients of these 

inequalities involve moments of the underlying distributions. 

Let iX,Y) be a random vector with density Pg with 

k 1 — 

respect to Lebesgue measure on R xR . The parameters 6 and 5^, 

are unknown with (©,11) £ Q d R xR , k _> 1. 1 _> 0. The problem 

k 

is to estimate 0 with a loss E W(©.-a. ), a svim of individual 

i-1 ^ ^ 

losses in estimating 9^^. Only nonrandomized estimators will be 
considered. Brown derived the inequalities for k = 1, but they 
have easy generalizations to higher dimensional cases. Below we 
give an inequality for k » 3 and 1 » 0 as used in Chapter 4. 

Let X = (Xj^.X^/X^) and the problem be of investigating 
admissibility of an estimator 6 (X) = (6^ (X) , 6^ (X) ,6 ^ (X) ) • Define 
r(X) = 6 (X)“2S and consider an estimator ^^(X) = * ^ ( X) / 

X(X) = (X (X) / ^2 (X) » ^3 ^2^) ) • risk difference between 5 and 

is 

A(©.T)) = Rie,n,6) - 


3 

= E 
i=l 


>,T}) [w(x^+rj^(x)-e^) - w(Xj^+y^(x) + x^(x)- 0 ^)] 


In the derivation below W , W and W'" denote the first, the 
second and the third order derivatives of W respectively. Also 
X^j (x) denotes the derivative of X^(x) with respect to Xj, 
i, j = 1, 2, 3. 

A Taylor expansion of w(X^+T^(X) + Xj^(X) - 0^) abotit 
Xj|^ + rj^(X)-0^ after ignoring the terms of third and higher order 
derivatives of W, i = 1, 2, 3, gives 




[-X^(x)w' (x^+y^(x)-0^) - ^x|(x) w"(Xj_+rj^(x)-©^)l 
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A1 so 

W (x^+ri(x)-ei) = w (x^-e^) + '>'j_(x) w"(Zj_)) 

and W’(Xj_ + r^(x)-ej_) = w" (x^+r^ (X) -e^) + ^ ^ix) w”‘ (z|) , 

where and Z^ are points lying between X^^+T^ (X) -©^. 

Ignoring the term involving W'" , 

3 

A(e,a) = .^^^(9,7]) [-^i^2S) { W (X^-0^) + rjL(x)w"(z^) } 

- Ix^Cx) w*(x^-ejj^)] . 

Notice that for squared error loss the above expression of A ig 

2 

exact. Further, expanding (X) and X^ (X) about 0 in Taylor series, 

3 

^Xj-0j) Xj. j (0) + ... 


X^(X) = Xj_(©) 

+ E 

j=l 

and X^(X) = X?(©) 

+ . . . 

This yields 


3 


A(e,S - E 

[-h 


- x^(©) r^(x)w"(z^) - E (Xj-0j)x^j (9) rj^(x) w"(Zj^) 

*st 1 

- ^X?(X)W"(Xi-0i) + ...] 

Finally, "y^CX) = Tj^C©) + ... and as an approximation we take 

3 ^ 3 

A(e,fl) = E [-X^(0)wV(x^-0^) - e <Xj-ej)x^j(9)wMx^^ 

i — 1 ■ i ■* 1 


- Xj^( 0 ) r^(©) w"(z^) - E (x^-e.)x^j (0) r^(9)w"(z^) 

- i x|(e)W'(x^-9^)] . 


( 2 . 6 ) 
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If there is a X for vhlch A(e,T]) of (2.6) is positive for all 
(0,1}) £ Q and the error in the above approximation is negligible, 
we can expect to be better than 6. This is what we have 
attempted in Chapter 4 for obtaining an improvement over the 
Pitman estimator of 9 « (0^, ^ ''here are the means 

of independent normal populations with common variance unity and 

©1 < ©2 < © 3 - 

Finally, we mention a result of CaridK 1983) about the comp- 
leteness of the class of all Bayes and generalized Bayes estimators. 
Sacks (1963) was the first to prove the completeness for estimation 
in one parameter exponential family with a general loss function 
satisfying certain regtilarity conditions. Brown (1971) established 
this result for a p-variate normal distribution with the identity 
as covariance matrix viien the loss function is quadratic vhile 
Berger and Srinivasan (1978) considered a p-variate exponential 
family and squared error loss. Caridi generalized this result to 
a p-variate exponential family vdth a general loss function. His 
set up is briefly described belowi 

Let X be p-dimensional random vector with density Pq(x) 

with respect to a a-finite measure jj on R^, given by Pq(x) = 

(x,9) S 

c(0)e , (.,.) denoting the usual inner product. The parameter 

space Q is any sxibset of the natural parameter space 
{ 0 £ R^: / e dp (x) < «> 3 . 

rP ” : 

Under certain regularity conditions on the loss function and the 
measure p, Caridi proved that if 0 is closed, the class of all 
Bayes and genereili zed Bayes estimators is complete. 
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In Chapter 3, Caridl * s result is used to prove inadmissi- 
bility of the MLE and the mixed estimators of two ordered normal 
means. 

Throughout the thesis f and stand for the standard 
normal probability density and standard normal probability distri- 
bution func±.ion respectively. Also denotes the m-dimen- 

sional normal distribution with mean vector r a-nd the covariance 

matrix E . However, a univariate normal distribution with mean p 

2 2 
and variance o will be simply denoted by N(p,o ). 
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CHAPTER - 3 

Simultaneous Estimation of Ordered Location Parameters 


3. 1 Introduction 


Let (X^ . . . , be a random sample from a continuous 

population with the density i = Assume that 

the k samples are drawn independently and that are ordered, 

oo 

S2iy ©2 — ®2 — *** — ®k' take / x f^(x)dx = 0, i = 1, ...,k, 

OO 

without loss of generality. For, if / x fj^(x)dx = i = 1, ...,k, 

— oo 

define X^j = j = l,...,n, i = 1, ...,k. The density of X^j 

OO 

is fj_ (x-Oj^+p^) = g^(x-e^), say, so that / x g^Cx)dx = 0, i = 

— OO 

l,...,k. The problem is of estimating 0 = (©^,...,9^) when the 
loss function is squared error, that is. 


2 ^ 2 
L . I ©~ ^ 1 — 2 (9j~aj) 

i=l . 


(3, 1. 1) 


When there are no restrictions on the parameter space, an estimator 
frequently used is the best translation equi variant estimator 
X = (Xj^, . . . , Xj^) / also called the Pitman estimator, where 


n 


, e, ^Tr_ 


, ^.2 

i oo n 


1 , « * • , Ic • 


(3. 1. 2) 


/ TT f/(X -0 )d©. 

-CO j=l 


Note that X is also the generalized Bayes estimator of 0 with 
respect to the uniforra prior on R . 

When the parameter space is restricted, we can use the 
analogue of the Pitman estimator, v^i eh is the generalized Bayes 
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estimator of © with respect to the' uniform prior on the restricted 
space. When 9^' s are ordered we denote this estimator by ^ = 

/ where 

k n 


"pr^^ir 



s.,.rQ n TT f. (X -e ) d© 

-LJ -L 

Ic n 

/ / FT TT f. (X. .-©. ) d©. 

i = l J=1 ^ 





r = 1, . . . ,k . (3. 1. 3) 

Blxamenthal and Cohen (l96Bb), for k = 2 and identical f^'s, 
proved that any estimator with the risk function never exceeding 
the constant risk of X is minimax. They use the fact that X is 
minimax for the unrestricted parameter space. In Section 3. 2 , their 
result is generalized to an arbitrary k and f ' s not necessarily the 
same. We also prove that for estimating a component 0^^ of ©, any 
estimator with the risk function always below that of X^ is minimaix. 

In Section 3,3, we consider two normal populations wLth 
means and © 2 * £ ®2' common variance unity. For esti- 

mating © = (©^,© 2 ), we give a class of minimax estimators, all of 
which are improvements over the usual estimator 25* We also obtain 
a minimal essentially complete class of estimators among these 
estimators. However, these estimators are inadmissible. We do 
not know vAiat estimators improve upon them. Another class of mini- 
max estimators is also given. An estimator in the former class 
turns out to be the best choice in the latter. A comparison of 
this estimator with the Pitman estimator is made. 

In Section 3. 4, we take up two normal popxilations with 
unequal but known variances and obtain two classes of minimax 
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estimators. The maximum likelihood estimator is shown to improve 

some of the minimax estimators. Also, all of these estimators, 

like the ones in Section 3.3, are shown to be inadmissible. We 

also prove the minimaxity of the Pitman estimator 5^ . 

Blumenthal and Cohen ( 1968b) obtained sufficient conditions 

for the admissibility and minimaxity of the Pitman estimator 6 when 

“P 

we have two populations with densities f(x-0^) and f(x- 02 )* Tii 
Section 3.5, we consider densities fj^(x-9^) and f2(x-92) for the 
two popvil ations, f^ and f^ not necessarily the same and develop 
sufficient conditions for the minimaxity of 6^. Some applications 
of these results are also given. 


3. 2 Generalization of a Theorem of Blumenthal and Cohen 


We first introduce notation for the general problem consi- 
dered in this section. 

Let ^ = i,...,k be real valued and independent 

random variables with hi having the density j = !#...» n 

with respect to Lebesgue measure. Assume 

oo 

/ X dx s= 0 , i t= 1, ,..,k, 

— OO 


without loss of generality. We want to estimate 6 = (6^,,.., 9^) ; 

I 

under the condition 9^ _< ©2 — '*• — ®k’ Denote by the restricted 

parameter space [ (9^, . . . , 9^) : — *** — ®k loss 

function L(9,a) and the estimators X and 6 be as in (3.1.1), (3.1.2) 

P I 

I 

and (3.1.3) respectively. Also define j 


-i “ ^^il'’ ’* '\,n-l^ ' ^ij “ ^i,j+i ^il' ^ - l,. . . ,n, 

' ' ' X ~ ' 1 ,f ♦ ' • ♦ , / 3c# 
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can also be written as 

where 


■^11 “ 


/ X fj^(x) fj^(x+y^j^) ... f^(x+yj^ 


■oi 




(3. 2. 1) 


(3. 2. 2) 


and 

CO 

rQj^(:yj^) = / f^(x) f^(x+yj^j^) ... f^(x+yj^ n-1^^^' ^ " 1/. .. /k. 

(3.2.3) 

Then the conditional probability density of given is 

Pi (Xi-©i, yi) , v^ere 




+yii> • • • ♦yi, n-i> 


’oi 


SIT 


(3. 2. 4) 


Let Y denote the k (n- 1) -vector ( Y^^/ • ♦ • • Since we have 
a one-to-one transformation from i» • • • » ^^i' ^i ' * * ' ^i n-1^ 

= (X. ,Y.), i = l,...,k, we can base estimators of 9 on (X/^)* I 

Hereafter^ i = will be arbitrary space^ ^i^*^ i 

■ , { 

a probability measure defined on the Borel subsets of ' 

In.: 1 i' 

> 0 on R X to R jointly measurable in the two variables and | 

oo \ 

f Pj^(x,_y^)dx = 1 for all ± = l,...,k, (3.2.5) ! 

— OO. ' 

■ ■ 1 

'OO 

/ xp^(x,_y^)dx = 0 for all i = lr...,k. (3.2.6) 

— 'OO 


It can be verified easily that the density given by (3. 2. 4) satis- 
fies (3.2. 5) and (3. 2.6) with = R*^”^ and (dy^) given by 

Poi‘^i’'^yir"‘^yi,n-r 
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v;e will write for x . . . j for 

V for ^ ^ 

From now on the observed variables are (X^,Y^) with 6 R^, 
~i ^ "^i' ^ “ l,...,k and the conditional density of given is 

^ ^ = 1 , 

In terms of the new variables the risk of an estimator 
6(X,Y) = ( 6^(X,Y) ,...,6^(X,Y)) fore « (0j_,...,e^) is 

” “ k 2 k 

R(©,4) =/.../ /.../ S (6 . (x,_y) -e . ) TT (x, -e , V J dXn, . . dx, 

- oo - oo i=i i = l 1111 1 k 

(d^r^) . . . (dy^) . 

(3.2.7) 


Also, the Pitman estimator 6p = ^ . . . , 6pj^) of (3.1.3) is given 

by 




/ • • • / I I ^ 

© issl 

k ^ ^ 

/ • • • / I r ^JL ^ ^ ““i ^ c3i©2^* • * cl0^ 

© 2 ^ ♦ • • i = 1 


” i 3 r — X/ • # • ^lc« 


( 3 . 2 . 8 ) 


Now we are ready to state the main theorem. 

k 

Theorem 3. 2. 1 » Let be a subset of R such that there exists a 
sequence • « • » ^jik^ ' ^ v^ich 

lim inf {(0^, . . . ,0^) ; • • • » £ 2^ } = R^ . (3.2.9) 

n -♦ OO 

If ^ is an estimator with 

R(0,S ) < R < °° whenever © ^2 , 

.... ' O 


(3. 2. 10) 
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where R is the constant risk of the estimator X, then is a 

minimax estimator of 0 for 0 £ E . 

— — o 


Proof: The proof of the theorem is essentially the same as that 

of Theorem 3. 1 of Bliomenthal and Cohen ( 1968b). To take care of 
different densities f^, i =■ 1,. ..,k, however, some necessary 
changes are made. 

Let be not minimax. Then there exists an estimator 
5° s (6°,..., 6°) such that 

Sup R(©,_6°) < Sup R(©,^) < R , 

9 £ z © e S 

— o — o 


Therefore there exists an e > 0 such that t 

. 

< R - e for all e £ ^ (3.2.11) 


Let (a^) = ( ' * * * '*^k^— ^ estimator defined by 


5!Ca^,x,y) = 6°(x^+a^^ ' 

and • • • ' belong to £^. 

a change of variables in the integrand 


a^j_, i - 1, . . . ,k 

The inequality (3. 2. 11) 
of (3.2.7), then, gives 


and 


R(©,^' (a^^) ) < R - e . 


(3. 2. 12) 


Following remarks of LeCam (1955, p. 80) one can show that viien 

* 

the parameter space is R , the class of all the estimators is 
compact after a compactifi cation of the space lA of estimates. 

Using this fact, condition (3.2.9) and inequality (3.2.12), we can, 
then, choose a subsequence of { ^' (a^^) } viiich converges weakly in 
limit to an estimator ^ = (6^,..,, 6^) satisfying 

6*) < R - e for all 0 6 'R^ . (3. 2. 13) 


t 
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Now/ for the unrestricted problem X is a minimax estimator (see 
Theorem 2.3, Chapter 2) and so from (3,2.13) we conclude that 
e = 0. This proves the minimaxity of 

Corollary 3. 2. 2 ; Let _6 be an estimator of 0 with 
R(0,^) < R for ©2 ~ — *** — 

where R is the same as in Theorem 3. 2. 1, Then _6 is minimax for 0 ; 

when ©2 ^ • • • < ©;j^‘ 

Proof . Take and a^^ = (i-l)n-, i = l,..,,k in Theorem 3.2.1. 

Remark 3. 2. 1 : Taking = X Theorem 3. 2, 1, we see that X is also 

a minimax estimator of 0 for 0 G E . 

— — o 

In the preceding set up, let us now consider estimation of ; 
a component of 0, say ©. , with loss function the squared error. Then i 

I 

X^ is minimax vhen the parameter space is unrestricted (see Theorem 
2.4, Chapter 2). Proceeding as in the proof of Theorem 3.2,1 we can 
prove the following result. 

I 

Theorem 3.2,3 : Let 6jj^(X/Y) be an estimator of 0^ with I 

R (©, ®2 - * ' * - ®k ' 

■ , ■ , 1 

where R^ is the constant risk of the estimator X^j^, Then 6^ is 
minimax for when ©^ ^ 

3.3 Two Normal Populations with Ecrual Variances 

In this section, we give two classes of minimax estimators, 
all of them improving upon the usual estimator. An essentially 
complete class of estimators among these estimators is also obtained. 

CENT-^^L library 

... . '^Anpur 
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These estimators are also proved to be not generalized Bayes and 
so according to a result of Caridi ( 1983 ) are inadmissible. 

The Mixed Estimators 

We start with a lemma due to Katz ( 1963 , Theorem 1 ). 

Lemma 3 . 3 . 1 ; Let = (5 estimator of 9 = (0^,62) viien 

the parameter space is = {0: _< 0 ^ ). Let the loss function be 

of the form 

W(63_-©^) + W(. 52 - 02 ^ ' ( 3 . 3 , 1 ) 

where W is a convex, even and nonnegative function. Then if 
Pqi ( 6j^> 62) > 0 for some ©' 6 Q^, 6 is dominated by 

6 ^ + (l-a)62, (l-a)6^ + a62) , 

where a = 1, if <5 < 5 

. ^ ^ ( 3 . 3 . 2 ) 

= a , if 6^ > 62, 

a is a constant lying between zero and one. 

Remark 3 . 3 . 1 : The estimator 6 . of ( 3 . 3 . 2 ) is called the mixed 

a"*" 

estimator of Hereafter we will use the term 'mixed estimator' 

for the mixed estimator of the usual estimator X* 

Remark 3 . 3 . 2 ; The proof of the lemma follows from the fact that 

W(a'‘'6^ + ( l-a''')6 2-0-^) + vX(l-a'^)6j^ + a''’52 - 02) 

< W(5^-©j^) + W( 62 -© 2 ^ 

whenever 6^^ > 62, 0j^ _< 02 0 < a* < 1 , 
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Remark 3. 3. 3 : The estimator ^ 3^/2 improves 6 is the projec- 

tion of j5 on the space 0^. A more general result of this type is 
stated below. 

Lemma 3. 3. 2 : Let h(©), the estimand, belong to r”"^, the loss func- 

tion be a strictly increasing function of the Euclidean distance 
lh(©)-6(x) I between h(©) and 6(x) and the estimation problem 

^ 'At 

(q,L,X) be restricted to (Q ,L,X), Q d Q . Denote the convex, 
closure of h(Q*) by Then any estimator 6(X) , satisfying 

P^,(6(X) 2 A ) > 0 for some ©' G Q* is inadmissible. 

t7 O 

Proof: We define 6* (x) = 6(x) , if 6(x) £ A 

o 

= 6^(x), if 6(x) 

where is the perpendicular projection of 6(x) on 

Now, vhenever 6(x) we have 

1 6^ (x) -h (© ‘ ) 1 < l<5(x) -h (© ' ) I 

by definition of a perpendicular projection (see Lemma 5.2.5). 
Hence R(e ' , 5) -R (© ' , 6 ' ) 

= / rL( lh{©')- 5(x) I ) - L(Ih(©')-6* (x) 1) ] dP 

= / + ' ^ [l( lh{©')- 6{x) l)-L(lh(©')-6' (x) I )] dP 

6(x) £ vAq 6(x) ^ vAq 

>0. This completes the proof of the lerana. 

Let X^ and X^ be independent normal random variables with 

means ©^ and ©2 respectively, ©^^ < ©2 and common variance unity. 

The mixed estimator 6 ^(X) for © - (ej_,© 2 ) is given by 

a 

6 ^(X) = (0^1 (l-a)X 2 , ( 1 -a) X^ + 0X2) , 


(3. 3. 3) 
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where a = 1 v^en 

= a'*' when X^ > x^, a"*" real. 

we show below that ^(x) tor 0 < < 1 dominates X = 

a ~ 

The risk function of ^ ^(x) is 

R(9/i^4.) = E(ax^ + (i-a)X 2 - e^) ^ + E((l-a)X^ + oX^ - ^ 2 ^ ^ 

■ = 2 + 2E(l-a)^Z^ - 2E(i-a) Z(Z-T1); 

where Z = ^1-^2 

T) = ©1-02 ^ ©1 :< ©2* 


Some further simplification yields 

/ 

Z>0 




R(©»i +) = 

a 


2 - 2a'^Cl-a'^) 


2 

z"^dP 


+ 2h(l. 


■a"^) 


/ z dP. 
z>o 






Now, 

/ Z^dP = (2+h^) fCn/\'’2) + v^2hcp(h//2) 

Z>0 


and / Z dP = V2 <f{V/^2) + n 

Z>0 

Writing £, = r? /v^2, we have 

= 2[(1 - 2a‘^(l-a^) 1(1+^^) $ ( ^) + ^9 ( ^ ^ 
a 

+ 2C(l-a'*‘)f 9(a 4 n , 

or 

R(©/5. +) = 2[l + 2(l-a'*’)2 U'Pta + ^ »(4)) - 2a'^(l^a‘^) $(0]. 

Since 9(0 4 ^ f(^) > 0 for all we have 

+) .< 2 for all ^ ^ 0 whenever 0 < a"*” < 1. 
a — “ 


(x^^x^) 


3. 4) 

% 


(3. 3. 5) 



55 


Therefore, ^ improves upon X whenever 0 _< a"*” < 1. From 
a 

Corollary 3. 2. 2, we have X a minimax estimator and so { (X) 

0 _< a _< 1 ] is a class of minimax estimators. 

Now, 

, 2(l-a'^)^ ^ f(0) - 2a'^(i-a‘^) $( 0 

= 2(l-a'")[ f(0) - a'*'($(a + Ct'PCO + ^$(0))] 

>0 

for a"*" > 1 as the second term in the square brackets is always posi- 
tive (a proof of this fact is contained in the proof of the next 
theorem). Hence ^ for a"*" > 1, is improved by X itself. However, 
^ ,, for a <0, has risk more than 2 at 0. = and less than 2 for 

0 2 much larger than 0^. Therefore they are not comparable to 2^* 

"f 1 

We also note that for a > 2 ' inadmissible by Lemma 

^ + 1 

3. 3. 1 and so we can restrict attention to a 

Next, we use the Brewster- Zidek technique (197 4) , discussed 
in Chapter 2, to find a class of estimators admissible in the 
class of mixed estimators. 


Theorem 3.3.3 ; The estimator 
the mixed estimators. 



for 



is admissible among 


Proof . From (3.3.5) we see that the risk function of for fixed 

+ • ^ 

is a convex function of a , Differentiating R (6,6 with 
+ ' 

respect to a and equating to zero gives 

a'*‘(^) = 1 - I f*(0. (3.3.6) 


where 


f*i0 = 


iin. 


(1+^^) ‘P(U 


(3. 3.7) 
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a'*'(5) minimizes R(e,^ _^) at Write 

a 

giO = (1 + C^) ^(0 + ^ 9(0. 

Clearly g(0) = Lira giO =0, Lira g(0 = + ~. 

— CO l^-♦+00 

Also g'(0 = 2(9(^) + 4 $(4)) > 0 for all O Hence g(0 is an 
increasing function of 4 and g(4) 2 0 for all 4 . 

Since 0 < g(4) < 0 £or 4 ^ we have f* ( 4 ) > 1 for 

4 0 so that a'*’(4) is bounded above by in 4^0, The upper 

bound is attained at 4 = 0. 

Therefore, we conclude by the Brewster- Zidek technique that 
the estimator ^ for a £ l] is improved by ^^^ 2 ' 

By a repeated use of L'Hospital’s rule, we get 



= Lira 

4 


=: + 00 

and so Lira ot"*'(4) = -«>. Now, we have a'^(4) continuous, a'*’(0) =s 
^ 4-* ~"i 

and a ( 4 ) <2 4^0# therefore any value a in the interval 

(- 00 ,^] is an a^(4) and so minimizes R(0,6 at some 4* Hence the 

+ 1 ^ 

estimator 6 .(X) for a < t? is admissible among the mixed esti- 
“a'*' " . ~ ^ 

mators (3.3.3). 

RCTiark 3.3.4 ; It can be shown easily that also the 

MLE of 0 for 0^ _< Finding the MLE, here, is equivalent to 

minimizing (xj^- 0 ^) + (x 2 -© 2 ^ with respect to ( 6 ^, 02 ) subject to 
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the condition that ^ 02' When < x^/ the minimizing choice 
of (9^,02) is, clearly, (xj^,X 2 ). VJhen Xj^ > X 2 , the minimizing 

X1+X2 ^1*^2 

is ( — 2 — ' 2 — prove this, we show that 

1 / f r\ \ I 

•^(Xj^-X2) ^ * ^2”®2 

for all x^ > X 2 and _< ©2 or, equivalently 

;j^(x^-X2) < [(Xj^-0j^)^ + (x2-02^ (3.3.8) 

for all > X 2 and 9^^ < 02* 'Ihe right hand side of (3.3.8) is the 
Euclidean distance between the points (x^,X 2 ) and (©^,© 2 ) and is 
larger than — - — , the length of the perpendicular from (x^, X 2 ) on 
the line x^ = X 2 - 

This proves our claim. 


Remark 3.3.5; Consider the estimators 




Min(X^, X 2 ) 


if X^ < X 2 



and (X) 



The risk of 6* 

— :Q 



(3. 3. 9) 


(3. 3. 10) 
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= / (x -e )^dp +. / (x„-e_)^dP 

Xi<X2 x^<X2 2 2 

+ / (X -© )^dP + f (X--0„)^dP . 

X^>X2 ^ X^>X2 ^ 


(3. 3. 11) 


The second and fourth integrals on the right hand side of 
(3.3.11) can be combined to get simply E{X^-e^)^ which is unity 
and so 


= 1 + / (X.-© )^dP + f (X-,-©J^dP 


(3. 3. 12) 


Now 


/ (X^-e^)^dP = / / <P(x^-©^) q){x2-©2)<3Xl^^2 


^i:^^2 


j (©J^-X2) <P(x2-©3^) <P(x2-©2)<ax2 


+ ^ ^( x 2 - 0 - l ) ? ( x 2 -© 2^'^^2 

— oo 


(3. 3. 13) 


using an integration by parts with respect to x^. 

To simplify the integrals in (3.3. 13), we use the following 
two identities: 


1 ^"^1 1 ^"^2 

^1 ^1 ^2 ^2 


a. -a. 


^/(b?-»-b?) "^(b^+b?) 


2 ■ 2 

<p(_l__2_)_4__2_ »p( 2 _ ^ - 1 


y7b^+^ ^/{b^+b|) 




^1^2 




oo x-a^ . x-a_ a -a 

and / $ ( - - ^, -i) ^ y (-- v: ~ dx ■> ) . 

1 '^2 w---5~T, 

^ (bj+bj) 


(3. 3. 14) 
(3. 3. 15) 


The proof of (3.3,14) is straightforward. To verify (3.3,15), 
consider two independent normal random variables and Y 2 with 
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2 2 

means a^, a^ and variances b 2 respectively. Then both the 
sides of (3,3.15) are equal to _< Y^) . 

Using the above identities, we get from (3.3.13), 

/ (X -e )^dP = 1 - $(0 + 4 I 9(0 . 

X^<X2 

In a similar way, we calculate 

/ (X -e,)^dP - til.) *1 £,T(0, 

and thus (3.3.12) gives 

=2[l + ^(9(0 + i ^(0)1\ 

v^ich is less than or equal to 2 for i < 0. Therefore, dominates 

X and is a minimax estimator by Corollary 3. 2. 2. 

★ 

The risk of 6 j, is 

= •( (X,-eJ^dP + / (X,-0^)^dP 

X^<X2 

+ / (x-e^)^dP + f (x-e)^dP. 

Xi>X2 x^>X2 

Combining the first and the third integrals in the above expression 
R(©,6*) = 1 + / (x„-e ) ^dP + f (X--e )^dP . 

2 2 

We notice that the integrals / (X_-0„) dP and / (X^-©^) dP 

Xi<X2 ^1>^2 ’ 

can be obtained from / (X,-e,)^dP and I (X„-e ) ^dP of (3. 3. 12) 

X^X2 X^>X2 

by an interchange of and ©2 and some adjustment- This gives 
R(©,6*) = 2ri + ^(9(0 * i 9(0)1 - R (©.£,) for all 0 

" ■ ■ it ■ 

and so the estimators and ^ are equivalent. Since the loss 
function is convex, any convex ocxnbination 
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6 o = 0 6* + (1-0) 6* , 0 < 0 < 1 


(3. 3. 16) 


of and is an improvement upon 6^ and 6*. Consequently, 

^0|3* O_<0_<l}isa class of minimax estimators. The risk of 6* i 


0 


R(e,^g) = / (X-9 )^P + / (x„-e )Mp + f (0X,.+ (i-0)x^-ej2^ 

Y ..Y -1- j- „ ^ /. /. v^vr -L 21 


Xi_<X2 


^1<^2 


Xi>X2 


+ / (0X + (i-0)x^ - e„)^ dP . 

Xi>X2 


After some simplification, we get 

= 2 + ((l- 0 )^+ 0 ^) / Z^dP + 2 ( 1 - 0 ) / (X_-X,) (x,-e,)dP 

^ Z>0 ^ 


+ 20 / (X -x„) (x„-e.)dP , 

Xi>X2 


(3. 3. 17) 


where Z is the same as in (3. 3. 4) . The integral f Z aP was 

Z>0 

calcvLlated in the derivation of R(0,^ ^.) and the last two integrals 

a 

are calculated using the identities (3.3.14) and (3.3.15) and are 
seen to have the identical value -$(^). This gives 

R(e,6p = 2 [1 + (0^+(l-0) ^) ((1+^^) f(0+^^(^)) - ^(Ol . (3.3.18) 

2 

Now, since (1+^ ) f ^ l’(^) >0 (see proof of Theorem 3.3.3), 

1 * 

0 = minimizes R(©»^p) and so i.a the best choice in the class 

ic 'Ar 

(5^: 0 0 < 1}. Incidentally, same as the mixed esti- 
mator ^^^2" also observe that 6^ is better than and £*_j 3 for 

0 < 0 "i worse for -^ < 0 <_ 1. 


Remark 3. 3. 6 : The problem is invariant under the transformations! 


X X + 3 . # 


(3. 3. 19) 


-► 0jj + a. 


1 , 2 . 



The form of an equivariant estimator is 


6 (X) = 


6^iX) 
<52 (X) 


^ 'r,(x^-X2) 

^2 


(3. 3. 20) 


Clearly, the risk of an equivariant estimator is a fu n ction of 
there is no best equivariant estimator. 

A stibclass of equivariant estimators (3.3.20) is 


6 (X) 


Xi - Y(X^-X2) 
X 2 + '?(X^-X2) 


(3. 3. 21) 


Notice that the mixed estimators are equivariant' and they are of 
the form (3.3.21). 

An application of Lemma 3. 3 . 1 proves the following result. 


Theorem 3.3.4; Let 6 (X) be as in (3.3.21) and P„ . ('F (X.-X..) < i 

C7 X ^ 

X 1 -X 2 ' 

— "Y "-) > 0 for some ©' £ q^. Then 6(X) is inadmissible. ! 

It is interesting to note that Theorem 3.3.4 can also be 

proved using the Brewster- Zidek technique by improving the estimator | 

_ 6 (X) on the orbits {(X^, X 2 )J ^ proof is s 

sketched below; 1 

The risk of the estimator 6 (X) of (3.3.21) is 

R(©, 6 ) = R(©, 6 , Z) , I 

vAiere R(e, 6 ,z) = E [ i(Xj^-'F(Z) -© j^) ^ + (X 2 +f (Z) -© 2 ) ^ ^ I Z = z] 


with Z the same as in (3.3.4). 


Now, the conditional distributions of X. given Z = z and X_ 
©l+ez+z , © , +»9-z 1 

given Z = z are N( 2 / - 5 ) and N( - i ^ A) respectively and 

so for fixed z and ©, the value of t minimizing R(©, 6 , z) is 
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fQCz) = ^ (z + 02 - ej^) , 

which has an infimum z/2 over the region 02 > 9^. Since R(©, d, z) 
iS/ for fixed z and ©, convex as a function of 'If with a minimum at 
’^ 0 ^ 2 ) > •z/'l, it follows that ’FCz) _< z/2 implies 

E[{(Xj^ - IfCz) - 0 ^)^ + (X2 + '?(z) - ©2)^}IZ = z l 

> E[ { (X^ - I - 0 ^) ^ + (X2 + I - ©2) ^ ] 1 Z = z ] 

for all ©^ < © 2 - Thus the estimator 6* (X), obtained by replacing 
^(Z) by max(?(Z), ^ in 6(X), dominates 6(X)# provided Pq,(Y(Z) < Z/2) 
is positive for some 0' £ q^. This completes the proof of Theorem 

3.3.4. 


Inadmissibility of Mixed Estimators 

We prove below the inadmissibility of the mixed estimators. 

Theorem 3.3,5 ? Mixed estimator ^ for any real a*, is inadmi- 

a 

ssible. 


Proof: In view of Theorem 3.3.3, it suffices to consider 6 for 


+ 1 
a < 2* 


Since the class of generalized Bayes estimators is complete 
(see p. 43 , Chapter 2 for the results of Caridi (1983), Berger and 


Srinivasan (1978) and Brown (1971)), it is enough to show that 6 
is not generalized Bayes. 


a 


A 4 . 
a 


( 


if Xj^ < X2 


f oXj^ + ( l-a)X2 \ 
Ml-a)X. + aX_/ 


i f > ^2 


Now, 
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Suppose ^ ^ is generalized Bayes for the prior f(©) with respect to 
a ~ 

Lebesgue measure. Then 

c» oo 

; / e tp(x^-9^) 9(x2-e2) f(9)d0^d02 

CO — oo 

~ ~ = X for all _< X 2 . 

/ / fCxj^-e^) 9 (x 2-62) f(0) dej^d©2 

^00 —00 

This implies that 

00 OO 

/ / (e-x) 9(x^-e^) 9(x2-e2) ^ 1 -^ ^ 2 ' 

— 00 —00 

or equivalently 

CO OO 

/ / 9(x^-0^) 9 (x2-62^ ^ ^1 — ^2' 

1 — 00—00 

and 

CO 00 

^ r f 'PCx^-©^) 9(x2-e2) f( 0 )d 0 j,d ©2 = 0 for all x^ < X 2 . 

2 —00 —00 

Therefore^ we must have 

00 00 

f f ^ constant) for all < X 2 

—00 —00 


Now, the family of bivariate normal distributions {N 2 (x,i)* < X 2 ^ 

is complete (see, for example, Lehmann, 1959, p. 132). Hence, we 

must have f(©) = -K a. e. Lebesgue and so ^ (x) = x for all x* vhich 

a 

is a contradiction. 

This completes the proof of the theorem. 


Remark 3.3.7 : The above method of proving inadmissibility does 

not yield a better estimator. We do not know vhat estiraator is 

1 

2 * 


‘I*' 1 

better than 6 for a < 





Remark 3.3.3: 


Katz (1963) considered the Pitman estimator 6 of 

-TP 


(3.2.8), which in this case is 

1 


ip(X) = 


X, 


Ti 




v(-f^) 

1 

^2 + 72 ^(- 72 ~^ 


where v(t) = 9(t)/$(t). He showed that 6 (X) is admissible and 

-p - 

minimax, though his proofs are inadequate. Biumenthal and Cohen 

(1968b) show in general for distributions with location parameter 

densities that _5 of (3.2.8) is both admissible and minimax under 

ceit-ain conditions. It is tempting to compare 6 with the mixed 

P 

estimator. The risk function of as given by Katz, is 

= 2 + v( -^ ^ ) . 

Since V is a nonnegative function, R(©,^p) < 2 for all ^^ 0. When 

^ = 0, that is, 9. = 9-, R(9,6 ) = 2 whereas R(9,^ ) = 2[l-a'*'( l-a"*^)] 

which is always less than 2 whenever 0 < a <1. The improvement is 

maximum when a"*" = 4. Therefore, ^ ^ and 6 are not comparable for 

a"*" ^ 

0 < a <1. ^ 1/2 preferred when 0^^ and 9^ are known to be 

quite close. When the difference, is large, 6 will be preferred. 

3.4 Two Normal Popxilations with Unequal Variances 

Katz (1963) has considered the normal problem for equal and 
known variances, whereas Biumenthal and Cohen ( 1968b) take up the 
estimation of location parameters when the scale parameters are 
equal and known. In this section, we stxidy two normal populations 
with unequal known variances and show that the MLE as well as the 
mixed estimators remain minimax Unlike the equal variances case. 
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the MLE is not a mixed estimator and it dominates some of the mixed 
estimators including Pitman estimator 6^ is admissible 

(see Cohen and Sackrowitz (1970)). V^c prove its minimaxity and 
compare it with the MLE and the rnixrxi estimators. 

Let and be independent normal random variables with 
means 6^ and ©2 variances x and 1 respectively. We assume a 

priori that < ®2* va.nt to estimate 0 = (©^^, 02 ) with squared 

error loss. 

The Mixed Estimators 

We have seen in Lemma 3.3.1 that the mixed estimators (3.3.3) 
improve upon the usual estimator X* T'he exact risk expression isJ 

R(©,6 ^) = (x+l) [l + ad-a**")^ X(<P(X) + X <P(X)) - 2a'^(l-a'^) $(X)], ( 

a I 

(3.4.1) I 

where X = /\/Tt + 1) • I 

+ I 

Clearly, R(0,^ + 1 tor X _< 0, 0 jc a <1. Thus, _6 , ‘ 

a cr,"^ ' 

for 0 _< a <1, improves upon X and so is minimax by Corollary 3.2.2. 

The estimator 6_ ^ for > 1 is improved by X itself. Also the ! 

■ 

estimator ^ O’ < 0 is not comparable to X* 
a 

Using the Brewster-Zidek technique, as in the proof of 
Theorem 3. 3. 3, we have the following result. 

Theorem 3. 4. The estimator ^ . for ^ 4 is admissible among 

a ^ 

the mixed estimators. 

The Maximum Likelihood Estimator 

I 

For this problem, finding the MLE is equivalent to minimizingj 
— (x--©.)^ + (x.,-©„) ^ with respect to (© ,©_) subject to ©. _< 9 
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This gives defined by (3.3. 16) as the MLE. The risk 

function of of (3.3. 16) is 

= f (x.-ej^dP + / (x„-e„)^dP 

X^<X2 

+ / (3X +(1-0)X -e ) ^dP + / (0x, + (i-3)x_-e-) ^dP, 

X^>X2 ^ X^>X2 ^ ^ 

which after some simplification becomes 

R(0/6o) = (1 +t) + (0^+(l-0)^) / (X,-X„)^dP 

+ 20 I (X -X ) (x,.-e^)dP + 2( 1-0) f (x„-x,) (x,-eJdP. 
X^>X2 ^ ^ ^ ^ ' 

The integrals in the above expression are calculated to be 

/ (X^-X 2 )^dP = (1 +t) {(1+kh .t(A) + X q>(x)} , 

Xi>X2 

f (X^-X-) (x_-e )dP =- ^(X), and 
^1>^2 

/ (x,-xj (x^-e JdP = - T $(x), 

Xi>X2 

where X is the same as in (3.4,1). Thus, wre have 

= (1+'^) [l + (0^+(l-0)-) {(1+X^) 4(X) +X <P(X)}] 

- 2((1-0)t + 0) $(X). (3.4.2) 


Now we prove the following theorem. 


•f 1 

(i) The estimator X for a > 1 - 


/■-2 


(T"+l) 

“72 ' 


Theorem 3. 4. 2 : 

is dominated by the MLE. (ii) The MLE is admissible among the mixed 
estimators and (iii) The MLE is also admissible in the class 

{6* : 0 < 0 < ll . 

—jy — — 



67 


Proof; From (3.4.2), the risk of 6*/, ,,, is 

2 

+ = (■^+1) [l + { X((p(X) + X #(X)) - f(X) }]. 

(t +1) 

(3.4.3) 

We notice that X(9(X) + X 'f(X) ) < 0 tor X < 0 and 2a‘*’( l-a"*”) < -i < 

, 2 . “ ~ - 2 

~ for ct and / 1. Now (3. 4. 1) and the fact that 2(l-a"^) ^ < 

(t+1) 

2 

9 prove (i) . The assertion (ii) follows from the fact that at 
(t+1)^ 

0, = ^9 the risk of _6 is always larger than the risk of the MLE. 

To prove (iii), consider the risk function of 6* and find that the 
0 minimizing the R(6/i5^) for fixed 0 is 

0(X) = I [l + ^ f*(X)] , 

where f is defined by (3.3.7). Clearly 0 = vAien X = 0 and so 

-jf . ^ 

Six/ ^(0/^1^) at 0^ => 02* Convexity of the risk func- 

tion in 0 ensures that it is the uniq[ue minimi zer. Hence ( x+i) 
i 3 -“ admissible among the estimators 0 < 0 < 1. 

Remark 3.4.1 ; It was shown in the proof of Theorem 3. 3. 3 that 

Inf f* (X) . = 1 and Sup f* (X) = -k». Consequently, Inf 0(X) = 

X<0 X<0 X<0 ^ ~ 

Sup 0(X) = +», if T < 1 and Inf 0(X) -= -«>, Sup 0(X) = if t > 1. 

X<0 X<0 X<0 

The Brewster- Zidek technique (197 4) then proves that 

* 1 * * 

(i) if T < 1, 6^ for 0 > is admissible among S^'s, and 

★ 1 ★ 

(ii) if T > 1, for 0 _< is admissible among s. 


Remark 3. 4.2 ; Inadmissibility of the mixed estimators can be 
proved following the same lines as in the proof of Theory 3. 3.5. 
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Reruai rk 3. 4. 3 i The MLE is also inadmissible, since as in the proof 
of Theorem 3, 3.5, it can be shoun t:o be not generalized Bayes. 

Invariance 

We can introduce invariance in this problem the same way 

as in Section 3. 3. The form o£ an equi variant estimator is the 

same as in (3.3.20). By an application of Lemma 3.3. 1 or the orbit 

by orbit improvement technique of Brewster and Zidek (l97 4) we see 

that Theorem 3.3.4 holds also in the set up of unequal variances. 

Next, we consider the Pitman estimator 6 of (3.2.8) v^ich 

~P 

in this case is given by 


6 (X) = 

-p - 


"pi® 

L"p2‘2S) j 


( 3 . 4 . 4 ) 


where 




" ®2 

/ / 0 
— OO oo 




CO ©2 

I f 


— OO — CO 


1 ^1"® 1 

y ( - / ■■■ - ) <P(x„-e„) de.de. 
\fj nTt 2 2 12 


- 


^2 ^1 
v(- ^— ^) 


vT+T Vl+T 


(3. 4. 5) 


and 


*p2^^^ 


OO ^ 2 ^ Q| 

/ / f(xj-aj)dejde3 

. ,00 — "OO' ■ 


OO ®2 


X.-© 


/ / 'P C ) ‘P (x2-e2)<i©3^d©2 


’ OO OO 


= ^2 


X.,-Xi 

v(-^— i) , 


/l+T '^l+‘ 


(3. 4.6) 


V being the same as in Remark 3. 3. 8, 
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We show in the following theorem that 6 is minimax. 

-V 

Theorem 3. 4. 3 : The estimator ^ of 0, _< is minimax when 

the loss function is squared error. 


Proof: The risk of 6 is 

-p 

= E I 6 -e 1 ^ 

ir Jr 




Vl+T v/T+t 


2 x_-x, : 

) - e ] + Efx +-^ v(-2— J:) _ e ] 


T^ + 1 2 

= 1 + T + E V (w) 


E(x,-ej v(w) 
/rTt ^ 


'/l + T 


E(X 2 -© 2 ) v(W), 


vT+t 


'/’i+T 


( 3 . 4 . 7 ) 


V^l ®2'®1 

where W = ~ N{^, 1) with i « —— 3 ;;;^ nonnegative. Now, 


E v^(W) = / v^(w) 9 (w- 5 ;)dw 


= / 


<p(w) <J„ 


# ^ ( w) 


= ?(w) ’<’(«) T('^i;) 


C w) 


— 00 — 00 


f(w) [ — — {- w 9(w) <P ( w-5) 
$^(w) 


- (w- 5 ) 9(w) «P(w-S)3 3 ^ — 'P^(w) <P(w- 2 )] dw 


f ( w) 


= EW v(W) + E(W-^) v(w) + 2 E V (W) 


and so 


E V (w) = E ( 5 - 2 W) v(W). 


Sxibstituting for E v'^(w) frdni ( 3 . 4 , 8 ) into ( 3 . 4 . 7 ) we get 


( 3 . 4 . 8 ) 
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= (1+^) + e(^-2w) v(w) ^ (X -e ) v(w) 

'/T+t ^ 

+ -=E(x,-e„) v(w) 

2 2 

= (I+T) + E[(T^-2T-I)e + (T^+2T-i)e. 

( 1 + t )^/2 2 1 

+ 2(1-T) (tX 2 +X 3 ^) ] v(w) . 

Since tX 2 +X^ and W are independently distributed, we get 

x2 

) = (1+T) + (e e ) E v(w), 

which is less than or equal to (ItT) for all _< 02. By Corollary 
3.2. 2, we get the result. 

Remark 3. 4. 4 i At 9^^ = 02 the risk of 0 < cc"*" < 1, is smaller 

a 

than the risk of 5^, Since 6^ is admissible, the two estimators 

are not comparable. Also the risk of the MLE is smaller than that 

at 0^ = ©2* Therefore, both the MLE and the mixed estimator 

_6 0 < < 1, though inadmissible cannot be improved by £ . We 

a P 

do not know yet any estimator dominating the MLE, 

Remark 3. 4. 5 i Observe that the sample means are sufficient and 
so the case of samples of different sizes from the two populations 
with eqpjal or unequal variances is covered by the results of this 
section. 

3.5 Two Populations with Location Parameter Densities Not 
Necessarily of the Same Form 

Blumenthal and Cohen ( 1968b) considered estimation of para- 
meters 0j^ and ©2 of two poptilations having densities f(x-0^) and 
f(x- 02 ) respectively and obtained sufficient conditions for the 




7 1 

minimaxity of the Pitman estimator ± . In Section 3.4, we proved 

that the Pitman estimator is minimax when the two populations are 

normal but have unequal variances. A more general set up would 

1 1 x-9 

have been of densities f ) and a ^ a in 

this section, we take up densities fj^(x-0^) and f^Cx-e^) with the 
set up of Section 3.2 and develop sufficient conditions for the 
minimaxity of the Pitman estimator. 

In view of Corollary 3. 2. 2, to prove the minimaxity of the 
Pitman estimator it suffices to show that ^ R for all 

© 2 ^ < © 2 * Theorems 3.5.1 and 3.5.5 we give sufficient conditions 

under vhich this holds. 

Theorem 3.5. 1 : If the densities Pj_(x,_yj^) , i = 1,2, defined in 

(3.2.4), have finite variance and if 

CO 

/ u p 2 (t.-v,^^) P 2 (u+v,y 2 ^d^ “ 0 for all v, and ^ 2 ' (3,5.1) 

— oo 

then R(0,6p) < R for all 9^ < 92* 

Proof s The proof of the theorem is similar to that of Theorem 3.2 
of Blumenthal and Cohen (1968b). Some changes are necessary as we 
have two different densities f^^Cx-e^^) and f 2 (x-© 2 )- 

The risk of the Pitman estimator = ^'^pl'^p2^' (3.2.7), 

can be written as 

oo oo 

-oo -oo ^ ^ 


R(0,6p) 
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If we use variables 
and define 


2 '^2 ~ 2 — place of 


01+02 


^2 = 


02-01 


(3. 5. 2) 


7 , « 


^p 1 -^ 5 o 2 


^P2~^pl 


the risk becomes 


) 


where 






r I f P^((z^p^) (z2^2^'-^1^ 

^ — oo - oo 


and 


(3. 5. 3) 


P 2 ^^ ^2 ^^^2 ^^2^ ^“^2^^ 1 1 ^ 2^2 ^ ^ dy ) ( 3 # b • 4) 




Iff (7^^-^^) Pi ( ( Zi-^i) - ( z2-M2^ 

P2^ ^ Zl“Ml) +( z2“^2^ (3.5.5) 


Using (3.5.2) in the expression (3.2.8) for 6 pi and 6 p 2 ' get 

oo oo 

■T / Ml Pi( (Zi-Mi) - (Z2-M2^-il) P 2 ( ( ^i-Mi) +( Z 2 -M 2 ) /X2^ 


o —°° 

r = 2 

1 OO 00 


/ / Pi ( ( Zi-Mi) - ( Z2-M2) P 2 ( (^i-Mi) +(Z 2 -M 2 ^ 

(3.5,6) 


and 


”’'2 = 


OO OO 

^ ^ *2. ^ 1 ^ ^ ^ 1 ””^ 1 ^ (Z2^*~'/i2) ^ ^ ^ 

O 'OO ' . ^ , 

00 00 

1 I ^ 1 ^ ^ ^ ^ 2 ""^ 2^ ^2*"^ 2^ * ^ 2 } 1.^^2 

^ O' ■ ““'OO ^ , , , 


(3. 5*7) 


provi< 3 ed the integral in the denominator is not zero. 
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Making another change of variables u = - ^2~^2 

in (3.5.6) and (3.5.7) we get 


y <7 -OP - <» 

1 " " Z., 

2 CO 

f / 


/ / u p^(u-v,Y^) P2 (u+v,Y 2) <3v 


Pj^(u-V/Y^) P 2 (u+v,Y 2 ) du dv 


(3. 5. 8) 


^2 “ 
/ ; 

— oo — oo 

^2 “ ^2 " Z_ 

2 oo 
/ / 


— CO — oo 


V p^(u-v,Yj^) P 2 (u+v,Y 2 ) du dv 
p^(u-v,Y^) P 2 (u+v,Y 2 ) du dv 


(3. 5. 9) 


provided / / p^(u-v,Y^) p 2 (u+v/Y 2 ) du dv > 0. 


— OO — oo 


Writing 


/ u Pj^ (u-v, Yj^) P 2 (u+v,Y 2 V = g(v,Y) 


we have 


= Zi - 


/ u P^^^'V^Y^) p 2 (u+v,Y 2 ) du dv 


f g{v,Y) dv 


/ V g(v,Y) dv 


'^2 “ ^2 " Z, 


/ ^ g(v,Y) dv 


provided / g(v,Y) dv > 0. 


(3. 5. 10) 


(3. 5. 11), 


We notice that ^2 depends only on (Z2*Y) awi riot, on Z^. 


Consequently 
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*v5 


Since the density of Z 2 is 2g{ z 2 ~^ 2 *^^ ' ^2 — estimator ’^2 is 

simply the generalized Bayes estimator of ^2 with respect to the 
uniform prior on the space M 2 > 0 and so 


^2^^1'^2'^2^ — 2 R(M2''^2^* (3,5.12) 

The resxilt of Farrell (1964, p. 980) proves that 

R(M2/T'2^ - ^(^ 2 -^ 2 ) = I for all M 2 > 0 (3.5.13) 

and Lim R(id^, r^) = f • (3.5.14) 

M2-<» 

If the condition (3.5. 1) is satisfied we have and 

^2' 1^ “ "§* This along with (3.5.13) and (3.5.3) proves that 

< R for all Mj^ and > 0. 

This completes the proof of the theorem. 


Some more notation is needed for deriving another sufficient 
condition for the minimaxity of the Pitman estimator. 

Let 

^2 

= .i Pi<x.j:i)dx , 1 = 1,2 

Z 2 

G(z2»y) = f g(v,x)<iv , 

^ rvi 


E (z2, j) 


1 00 

= 4 / X P2(x,:i:2^ Pj(x-2z2,y3L^dx 

-^^00 



CO 

f X P2(x,jf2^ [ 1 -P j^(x-2z2#^2^ ^ 



00 
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OO 

F(z 2 ,J-) = / X p^(x,_Y^) P 2 (x+ 2 z 2 /:i: 2 ^^^' 


e(z2,j) = e(z2,:z)/g(z2,:y^ * 


F ( 

K ( Z2,y) 
H(z 2/:^) 
and T(z 2 /Jz) 


F(z2, . 

- {F{z 2 >X^ + E (z2,:^) ) , 

A A 

F(z 2/^) - E(z2/Jf) # 

OO 

f X P]^ (x- Z2 »;Yi^ P2(x+Z2 / ^2^ 


We see that 


OO 2 

/ / 

— OO — OO 


= i / / 


u p^(u-v,3r^) P2(u+v,_^2^ 

(s+t) p^(s,_y^) p2(t,_Y2^'^^ 


OO S+222 


“OO — OO 

OO s+2z. 


= 4C ■'■ •'■ s P2(t,^2^^t ds 


— OO — OO 


OO OO 


(3. 5. 15) 


+ 7 f t Pj^(s,_Y^) P2(t,_Y2 ^ ‘■-^3 dt] 

-00 t-2z2 

1 r ” OO 

= L / s p^(S/y^) P2 ( s+2z2/Ji: 2) + / t P2(t,^2) ^l~Pl(t~2z2,:ir3_) )dt] 

= F( z2/3r) - E( z2,:z) • 

The first and the second equalities follow from a change of variable: 
and the third and the last equalities follow from definitions 
(3. 5. 15) . 

In a similar manner, we can show 


f V g(v,^)dv = - E{Z2,i) - F(z2#^). 
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Therefore, we have from (3.5.10), (3.5.11) and (3.5.15), 

^1 = Zi-H(z2,3:) (3.5. 16) 

and = Z 2 -K(z 2 ,i) (3.5.17) 

whenever G{z 2 ,y) > 0, and and = ^2 otherwise. 

We need some lemmas before stating the main theorem. These 
lemmas are generalizations of Lemmas 3. 1 and 3.2 and Theorem 3.3 of 
Bltmienthal and Cohen (1968b) in the sense that f(x-©j_) and f(x-© 2 ) 
these, are replaced by fj^(x-©^) and f 2 (x-© 2 ). The proofs of 
Blumenthal and Cohen require some simple changes. We prove these 
lemmas for the sake of completeness. 


L emma 3. 5. 2 ^ Let 7^ and 7^ the components determining the 

Pitman estimator as defined in (3.5.2). Then for each (z^,_y) 

(3.5.18) 


Lim ( 7^-z^) = 0, 

Z 2 -C 0 

and Lim ^”^2" ^2^ ~ 

Z 2 -.C 0 


(3. 5. 19) 


VJhenever G(z 2 ,:z) > 0, ^2‘’^2 ^ nonincreasing function of Z 2 / and 

IH(z2,z)I < - K(z2,^). (3.5.20) 


Also, Lim Lim R(>i ^ 2 ' ’’' 2 ^ ** ^ 


JJ. ^ -♦OO jJ. 2*^^ 


Proof: We have 

z. 


(3. 5. 21) 


'2 «> 


/ / u p^(u-v,2£j|^) P2(u+v,_y25 


7 -z, = - 

1 1 Zo ^ ■ 


/ 7 Pj^(u-v,_yj^) P2(u+v,_y2^^^ 


<X> • — OO'. 


and 
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/ V g(v,_Y) dv 

"" OO 



— oa 


g ( v,_y) dv 


Using the fact that f x » 0, i =1,2, the statements 

— OO 

(3.5. 18) and (3.5. 19) can be proved. To show that ^2~^2 non- 
increasing in Z 2 » we consider 

^2 ^2 




- Z2 9(^2 # 3 ^) / g(v^jif)dv ^ ^ ^ 9 (v^J^)dv 

— to — OO 


r ^ 1 

—9 L / (V-Z 9 ) g(v,y)dvj 

G (z 2 /^) 


which is negative as g and G are positive functions and so 
is nonincreasing function of Z 2 . 

The inequality (3.5.20), by definition (3.5.15), is equiva- 
lent to F(z 2 ,:y) > 0 and E(z 2 *i) > 0 * ^ow. 


OO 

F(z2 »U^) — ^ ^ P x+'2 z ^ ^ 

— OO 

OO x+ 2 z 2 

= / 7 X Pj^(x,_yj^) p 2 (t,^ 2 ^^^ (3.5.15)) 

^ «.00 — OO 

00 00 

= 4 / { / x Pj^(x,3r^)dx ] P 2 (t,^ 2 ^^^ 

-OO t- 2^2 


by an interchange in the order of integration. For each t, the 

OO 

inner integral is al^srays positive as ^ x pj^{x^ 3 rj^)dx = 0* There- 

— ya ' ' 

fore, F(z 2 »i) > 0* 

Similarly, E(z 2 ,:y) > 0.- This proves (3.5.20), 
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To prove (3.5.21), consider of (3.5,4), 

by (3. 5. 16) i s 


viiich 


oo oo 


Ri(Pi,M 2' ^l) = ^ J J (2i-H(z2,y)-iij^) ^ p^( (z^-Mjl)-(z2-M2) 

\J 

^i-iii) -♦•( z2“P2^ 


<X3 OO 


P2( (zi-Mi) +( z2-P2^ *^^2 


OO oo 


*4-’- 

'*‘^^2~^2^ '•^2^^^1 ^^2 

OO OO 

+ 2 f f f H(z 2,JZ^ p ( ( z^^M - ( Z2-M2^ 

P2( (zi-Mi) +( Z2“M2^ ^.^2^ 


— 0 ^2^^1*^2^* sey , (3.5*22) 

where and I 2 denote the second and the third integrals respec- 
tively. 


We proved in (3.5.20) that IH(z 2 ,y)l _< - K(z 2 ,^) for all 

2 2 

iz 2 ,x) such that G(z 2 >J£) > 0. This implies that H (z 2 '^^ S ^ 
for all (z 2 /^) such that G(z 2 »y) > 0. We also proved that -K(z 2 /Z) 
decreases to zero as Z 2 increases to «>. A change of variables 
inside the integrals and I 2 end an application of the monotone 
convergence theorem, then, - proves that 

Lim l3^(P]_,p2^ “0 aixi 
^2- “ ^ ■ 

(3.5.23) 

Lim ■ ^2^^1^^2^ * 0. 

^2-*" 


Therefore, we have Lim **^1^ 

'^2- " ' 



(3.5. 24) 
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Relations (3.5.3), (3.5.14) and (3.5.24) now prove (3.5.21). 

Le^ ^a 3.5.3 : Suppose for each there are real numbers b(jir) and 

c(^) satisfying 

)3(y) < c(y) and ; g(z~,y)dz, » ^ . (3 5 2' 

b(y) 2-^22 lJ.b.2. 

Also, let E(z 2 ,y) and F(z 2 ,y) be monotone functions of Z 2 for each 

y such that G(z 2 ,y) > 0. Denote the risk of the Pitman estimator 

ip t’Y R T'l' '>' 2 ) where 7 ^ and are given by (3.5.2). 

Then 


R(M2»M2' ^ R if ^2 2 0 ♦ 

Proof ; Define, 

c(jy) “ 

^^^l'^2' ^1' ^2"^^ = 4 / / [ ( '>'^(z2+M2' ^ 

b (^) -" j. .c ^ X i 


(3. 5. 26) 


+ (72(22+^2' -M2) 

Pj((2^-M^)- ^^2 

(3.5.27) 


and 


c (^) 


““ 2 2 

R(y) =4 f /^(z^ + Z2) p2(z^-t-Z2,y2^^^1 ^^^2 (3.5.28) 


b(y) 


From the expressions (3.5.10) and (3.5.11) for t'i and and the 

~ , c(y) ■ 

conditions / xp. (x,_y, )dx = 0, i = 1, 2 and / g(z-,Y)dzT = 1, 

^ b(jr) ^ 2 

we have and = Z 2 whenever Z 2 > c(i|r). Thus 


R(Mi.P 2/ ’’i' '’' 2 '^) “ ^^X) if ^2 ^ (3.5.29) 

Next, we define 

r(d) = / (R(:y) - (3.5.30) 
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We will show that r(d) is decreasing in d. Let 0 < d^ < then 

oo 

r(d^)-r(d 2 ) = / 

oo 

The two integrals are finite as the integrands vanish for ix^ > 
c (jjr) -b (^) -d and > c(^) -bCjf) -d^ respectively, and so we can 
combine them to get 


oo 

r(d^)-r(d 2 ) = / [R(Mi,M 2 -»^ 2 ' ^ 2 '^^ 

o 





Prom relations (3.5.27), (3.5,16) and (3,5.17) we get 

OO OO OO ^ 

r(d^)-r(d2) = 4 / / / [ ( Zj^-H( z2+M2'R^2'-^^ 

O —oo — oo 

2 

+ (z 2 +M 2 ’^ 2 “^^^ 2 ‘’'^ 2 '*^ 2 '-^^“^ 2 ~'^ 2 ^ 

2 

- (z^-H(z 2 +M 2 'R^ 1 »(Z) “Mj^) 

2 

- (z2+M2'R^l”R^2:2+M2‘R^l#i)“l'-2”^l^ 1 

p 2_(^ ^ l"”^ 1^ ** ^ ^2'”^2^ ^ ^ 1^ 

P 2 (( z ]^- Mj ^) +( z 2 - M 2 ^ ^^^2 ^^2 * 

A change of variables and some simplification yields, 

r(d.)-r(d2) = 4 / f £[H (z2+d2'.^)-R giz2~^2'^^ 

+ [K^(z2+d2'-i(^~^^^^2'*^l'-^^^ g(z2-M2*^^ 

- 2[K(z2+d2»J^)-K(z24dj^,^)] (z2-P2^ ^ 

The above double integral is absolutely convergent due to (3.5.29) 
and the fact that g(z 2 .jr) vanishes foi: values of Z 2 outside the 
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interval (b(y) , c(;ir) ) . Therefore, we can interchange the order of 
integration. Making a transformation using (3.5.15), 

(3.5.16) and (3.5.17), we get 

r(d^)-r(d2) = 4 r l[H^(22-K32/y)-H^(22-^^,3r)l G(z2,^) 

- 2[H(22-K3 2 .:z)-H(z 2 '*^^r-^^'! 

+ [K^(z2+d2,Jf)-K'^(z2+d|^,j;)] 0 ( 2 ^,^^) 

- 2[K(z2-Ki2/lf)-K(z2'*<J|*Jii:)l K(z2»^) G(z 2/^)^ dz2 

(3.5.31) 

Once again using definitions for 8 ( 22 ^^) and K( 22 , 3 :) and simplifying 
(3.5.31), we get 

00 

r(d^)-r(d2) = 8 / G(z2,y) { [E(22+d2'-^^~® ^ 

+ [f( 22+d2»:z)"F(z2‘’^l*^^^ ^ 

+ 2[E (22+d2/y)-E(z2-k3j^,i)][ E(22+dj^,j)-E(z2/X) 1 
+ 2[F(z2+d2.^)-F(z2+d3^,^)l[ F(z2-*cl2^/y)-F(z2.y) 1? dz2 

A A 

Monotonicity of the functions E(z 2 ,y) and now proves that 

r(d) is a nonincreasing function of d, that is, r(d^) _> T(d 2 ) for 
0 ^ d^ < d 2 , v^ich is equivalent to 

f iR{2£) - '^ 1 " ^ ° ' (3.5.32) 

^1 

Since R(M 2 »M 2 ' 7 l' '>' 2 »z 5 is a continuous function of ^ 2 ^ (3.5.32) 

yields 

R(y) > R(Mj^,p2' '^1' '^2'-^^ ■ ^^2 - ° • 

Integrating on both the sides with respect to the measure v, we get 
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< R for all ^2 2 0 • 

Lemrna_2iJi4: Let the density p^(x,jy^), i » 1,2, defined in (3.2.4) 

have finite variance and the functions ECz^.:^) and P( 22 ,:ir) be mono- 
tone in Z 2 for each _y such that G{z 2 #^) > 0. Then the Pitman 
estimator ^ is miniraax, 

Jr 

Proof. In view of Corollary 3. 2. 2, it suffices to show that 

< R for all ' 

Define density p^(z^. z^,y) for each n > 1 and for all y by 
Pn^^l'^2'^^ = Pln(2i-22'^1^ P2n^ ==i’^^2'^2^ ' 
where P2n^^l'*’’^2'^2^ " Pi ^ P2^ ^l'*’^2'^2^ 

for I 22 I < n 

“ 0 otherwise. 

Hereafter, we proceed as in Farrell (1964, pp. 985-986) with some 
changes necessitated by the fact that Farrell considers estimation 
of a location parameter © of a density f(x-©,y), © > 0, vAiereas we 
are estimating parameters ©j^ and ©2 of densities f j|^(xj^-0 and 

^ 2 ^^ 2 “® 2 '^ 2 ^ ' ®1 - ® 2 * 

Theorem 3. 5, 5 j Let the densities Pj^(x,^j^) of (3.2.4) satisfy 
the following conditionsi 

Pi ^x,y.) 

-r-^ — r- — y is an increasing function of x for 
1— F -^1 ' 

each 

P2(x,y2^ 

• 5 -=-i <r is a decreasing function of x for each _y~. 

P2vXt3^2' 


(ii) r2(x,y2^ 


(i) q]^(x,y3_) «= 


Then 6 is minimax. 

_p 
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Proof : Following Lemma 3.5.4, it suffices to show that the condi- 

tions (i) and (ii) imply the monotonicity of the functions E(z 2 #y) 

A. . , 

and m Z 2 for each fixed jy, for v^ich G(z 2 »y) > 0. By 

A ( 1 ) ( 2^ 

definition, F(z 2 t^) - equivalent to 

^ ( 1) «> ( 2) 

/ X p^(x,:y^) P2 Cx4-2z2 ^ x p^(x,^^)P 2 (x+ 2 z 2 

—00 _ 00 

— > 0 , 

00 ( 1 ^ 00 ( 2 'i ” 

/ Pj^(x,^j^) P2 (x+2z 2 ,:y2^^^ ^ Pj^(x,y^) P2(x+2z2. #:Z2^^^ 

—00 — 00 

or 

00 00 

/ / x[P2Cx+2z2^^ 

—00 — 00 

- P2(x+2z 2^^ ,^2^ p ( x,y^) P 2 (x,jf^) du dx > 0, 

which by a break up of the inner Integral in u in intervals (-», x) 
a n d (x,oo) and then by an interchange of order of integration is 
equivalent to 

/ / (x-u)[P2(x+2z2^^:^2^^2^'^■^2''2 '^2^ 

— 00 —00 

- P2(x+2z2^\y2^^2^^'*’^^2^^ '-^2^^ ' (3.5.33) 

Condition (ii) implies that log •:L-^ is concave for each 
jy 2 and so for u < x and z^ < ^2 integrand in (3.5.33) is 

• A" 

nonnegative. Thus F(z 2 »x) is nonincreasing for each In a 

similar way, E(z 2 /Z^ can be shovm to be monotone for each jy. 

This proves the minimaxity of 

As an application of Theorem 3.5.5, we have the follovd.ng 

result. 

Corollary 3.5.6 : Let the density of i^x-O^^), i = 1,2, have any of 

the following forms’-. 
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(i) 

fj_ (x) 

_ ^ cp (^) , 0 > 0, -«» < X < «> 

i ‘^i ^ 

(ii) 

f^(x) 

" -a^ < X < a^. 

(iii) 

(x) 

= exp(-0^x)/r(a+l) , X > 0, a > 0, 0, > 0. 


Then the Pitman estimator is minirnax, 

— 3.; j ,r . ^ • Theorem 3.5. 1 is quite restrictive in applications. 

Blxiraenthal and Cohen (1968b) state that the condition for Theorem 
3.5. 1 is satisfied by the uniform distribution considered in 
Corollary 3. 5.6(ii) with =• !• This is not true as shown 

below. The density pCx,^) is (see Blumenthal and Cohen (1968a, 
p. 510)), 






where 


= tt'ax(0,yii, . . , ,yi^n«i^ - «'in(0, y^^, . . . , y^^ . 


Now 


/ u p(u-v,y^) p(u+v,y 2 )du 


" -CO ^2-Rn(i:i)H2-R„(i2yr ^A(y^) ^ (3.5.34) 

where It 3 (x) denotes the indicator function of the set B and . 

O ' 

A (:2:V = [~ 1 — ~ 2 — ' ^ ' 2 ^ * 

It is obvious that the integral in expression (3. 5.34) is not neces- 
sarily zero. 

The minimaxity claim, hpwever, is true as mentioned in 
Corollary 3.5.6, 
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CHAPTER - 4 

Simultaneous and Componentwise Estimation of the 
Ordered Means of k Normal Populations 

4. 1 Introduction 

In Chapter 3, the Pitman estimator of the mean 0 = (©^^Q^) 
of two normal populations with equal or unequal variances was seen 
to be minimax. Also, in general, vAien the two populations have loca- 
tion densities f^(x-©j|^) and f 2 (x- 02 ) / sufficient conditions for the 
minimaxity of the Pitman estimator were derived. In this cdiapter, 
we consider this question for more than tvo normal populations. The 
problem of estimating components o£ © is also considered. 

In Section 4. 2, we consider simultaneous estimation of the I 
means © 3 ^,..., © 3 ^/ 0 ^^ < ©2 < ... < of k independent normal random ^ 

variables with common known variance. The loss function is taken to i 
be the squared error. The Pitman estimator 6 ^ of (3.1.3) is shown j 
to be minimax for any k. The proof uses an identity originally given 
in Stein (1973) and later generalized by Hudson (l978) and Stein 
(1981), A class of minimax estimators is also given. However, thesei 
0 stimators are not generalized Bayes and so inadmissible* 

Inadmissibility of ^ follows from the results of Brown 
(1971, pp. 898-899) for k > 3. However, Brown does not give any 
dominating estimators. Followix^ the hexoristic approach of Brown 
(1979) to prove inadmissibility we obtain an estimator ( 2 SV' >^ich 
we feel, may possibly improve ^. We also use the Brewster- Zidek 
(1974) technique to prove that is admissible among its multiples 
and to obtain a sufficient condition for its inadmissibility in a 
certain class of estimators* x. 
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In Section 4 . 3 , the problem of estimating a component 0 ^^ 
of 0 is taken up. When k = 2 and the two normal populations have 
unequal variances, Cohen and Sackrowitz ( 1970 ) proved that the 
component 5^2 of ip for estimating ©2 minimax with respect to 
squared error loss. A symmetry argument proves minimaxity of 6 ^^ 
for However, a different situation is encountered \dien k = 3 , 

We show that the components 6 . and 6 -3 of 6 for estimating ©, anH 

J- P J '‘ "'p 1 

63 respectively, are not minimax. The minimaxity of 6 , for 0 is 

p 2 2 

an open question. 

In the end, we consider estimation of the larger location 
parameter ©2 when the underlying densities are f(x-0^) and f {x-02) , 
0 ^ < 02* When f is symmetric about 0 , we prove an inadmissibility 
result which generalizes Theorems 2 . 1 and 5 . 1 of Cohen and Sackro- 
witz (197 0 ). 

4 . 2 Simultaneous Estimation 

Let X^, X2, . . . , be independent normal random variables 
with means 0^^, ©2# . . . ,0j^ respectively; ©^^ < ©3 - **• ®k;' 

common variance unity. We estimate © » ( 0 ^^, ...,©^) with squared 
error loss, 

L (0 , a ) = I ©■" s I . 


Minimaxity of the Pitman Estimator 

We show in this section that the Pitman estimator 6 is 

-P 

minimax.' The form of 6p = is 


6 j_ (x) = f e^ p(x,e)d9 / f p(x,0)d0 , i = l, 2, 

^ 0^ Qr. 


,k, ( 4 . 2 . 1 ) 
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where p(x,©) ='P(x^-e^) tpCx^-e^) ••• 

©j^) * ••• <: ©1^ 3 / 


and d© denotes d©- . . . d©, . 
~ 1 k 

Define 


a^{x) =^/ p(x,©)d© , i = l,...,k 

o 


and D(x) = / p(x/©)d© • 

°o 

Then <5pj_(x) = x^ + T^(x) , 
ttf ( x) 

where Tj^Cx) = p- ^y ■ / i = k . 

Notice that a. (x) = D(x) . 

jL **** 0 

Also define. 


“o = ^1- “l = ='2-^1' “2 * =^ 3-^2 “k-1 “ V=^-l ' 

and 

pQ = ©Q^*^ ^2 * ®3~®2'*'’'^ 1 ~ ®k”^k 1 ' 

The parameter is nonnegative for i = 1, 2,...,k- 
terms of notation (4.2*8), D ( x) can be written as 


D (u) = / ... / / Cp(u^-^^) ^ (U^+Uj^-P^4p^) 


O — oo 


<P (u^+u^+. . . +Uj^_ i-Mq+Pi+. . ♦ j) <3 Mq • • cIM3^_ y 

where u = 1 ^* Observe that D* does not d^end 

Transforming the variables p^, p ^ bo 
l“^k 1 respectively inside the integral (4.2.9), we 


( 4. 2. 2) 

(4. 2.3) 

(4. 2. 4) 

(4. 2.5) 
(4. 2.6) 
(4. 2.7) 

(4. 2.8) 

In 

(4. 2. 9) 

on u . 
o 

get: 



88 


D { u) = / 


I f ,) ... (p(u +M. +. . . +M^ J 


• • • ^Mv_ 1 * 


(4. 2. 10) 


As an obvious consequence ot the expression (4.2.10), v.'e 


get the following result. 


TC 

L emma 4. 2. 1 : D (u) is an increasing function of each of the vari- 


ables u^/ u^, . . . , 


Before proving the main theorem of this section we state an 


identity due to Stein (1981). 


L emma 4. 2. 2: Let Y be a k dimensional normal random vector with 


mean vector V and the covariance matrix the identity matrix. Also 


let V be the vector differential operator of the first order partial 


t in 3 Ic 

derivatives with i co-ordinate If h: R -» R is an almosi 


differentiable function with iv h(Y)| < oo, then 

7} - - 


E„(vh(Y)) =E_{(Y-h) h(Y)l. 

T2 - - D 


Theorem 4.2.3 ; The Pitman estimator 6^ is minimax. 


Proof: The risk function of ^ is 


R(e,ip) = E I ip-e 


E E(x^ + r^(x)-©^) 

i=l 


= k + Z B {rfix) + 2E(X^-e^) ). 

i=l 


( 4 . 2 . 11 ) 


From Lemma 4. 2. 2, we get 


E ( "n ( 2?) = ® ^3X7 "^i ^ 


= E(- r^(X) + 5^ \ 


a , ( X) ) 
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using relations (4.2.6) and (4.2.7), 

Therefore, v-e have from (4. 2. 11) 

R(e,^p) = k + E(X^Y(X) ^ a^(X) - 


r^(x) ) 


(4. 2. 12) 


We show below that 


Vr 

E ^ "*■ STjr* -0 for each x ^ R 

1 = 1 1 

From (4.2.3), 


(4. 2. 13) 


£ (x^a.(x) + ^ a^U)) 


i «= 1 


= E [ / (©^-Xj^) p(x,e)d0 + •/' 1 


i = l 


1 0 


jv 2 

= E [ Xji^ / (©j^-x^) p(x,©)d© + I ( (©j^-Xj^) -l)p(x,©)d© J . 


Qq ^ 


Combining the two integrals above, we get 


JS. ^ 

E (x, a’(x) + a^ ( x) ) 

i=l i i - 3^1 > 

k 

= E [ •/■ (©j^ (©^-Xj^)-l)p(2C.®)<3£ 1 . 
i=l Qo 


(4. 2. 14) 


Consider integration by parts of with respect to 

i = 1, . . . ,k on the right hand side of (4. 2. 14) to get 


/ (©j^(©j^-x^)-l)p(x»§)d© 

0^ 


oo \ 


©. 


= - / / ... / ©2 'P^®2''^1^ ?(e2-X2) ... d©2 ... d©^ , 


— OO “"OO 
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Qq 

oo \ 

" " 4o -CO *** -CO 'P^®rX2))'P(©i-x^)9(©3-X3) ... 

<P(e^-Xj^)dei d 03 ... d9^ , 


/ (e^(0^-Xj^)-l)p(2c,9)d0 

Qq 


« ®k-l 
= f f 


— oo — 00 


e. 


' \-i 


^®k- r^- 1 ^ 1 * * ' 1 


By 


Adding the above identities, 
k 

^ ^^i^i^~^ '*’3^ a^Cx)) = 0 

.asl i . 

Next, we prove 


we get from (4.2.14), 
for all X 6 . 


k » 

L a. (x) =0 for all X e R . 
i=l ^ 

definition (4.2.3) 
k k 

E tt, (x) a E / (©,-x,) pCxr®)'^^ • 

i=l i=l Qq 


(4. 2. 15) 


(4. 2. 16) 


in the proof of (4. 2.13), we integrate (e^-Xj, ) p(x,0) with 
respect to 0^, i = l,...,k, on the right hand side of (4.2.16) 
and obtain the following relations 
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f (0^-x^) p(x,0)d0 
Qq 


oo \ 


0 . 


” ■ 1 !„■■■ L 'Ke2->=2)...f(e^-V<aer..de^ - 


/ ( 02 -X 2 )p(x» 0 )d 6 


Q 


OP \ 

- f f 

— OO — OO 


0 . 


^ ('P(e3-x2)-<P(e^-x2) ) «p(ej^-x^) <p(e3-x3),., 

‘P(\-\)d0i d 03 ...d©^ , 


/ (0^-Xj^) p (x«Q)d0 


~ ®k-l 


0. 


= f 


— 00—00 




Adding the above relations we get (4. 2.15). 

Using (4.2.15) alongwith the definitions (4.2,8), one can 
easily verify the following relations among a^ (x) and D* (u) , 

iL — f 


a ^( x ) = - D ( u ) , 


“ 2 ‘^> = “*‘s) . 


(4. 2, 


\-l 


(x)' ’»■ ' D . {l|) . C u) # 




s'V-i 


and a^(x) = D* (u) 


17) 



From (4.2.17) 


W ® 1 ^ ♦ e, 5^ D* (u) - ^ D* (u) 


+ . . . + e 


k ¥ 


k-l 

i=l o “ 


\-l 


d’^(u) 


(4. 2. 18) 


S\ibstituting from (4.2.13) and (4.2,18) in (4.2.12), 

R(e,^) = . 


i = 1 


(4. 2. 19) 


The fact that m^’s are nonnegative over o and Lemma 4.2.1 prove 


that 


^ all ©So 

— -*p — — o 


(4.2.20) 

Since the risk of X » (Xj^, . . , ,Xj^) is k, vje conclude from Corollary 
3.2. 2 that is a minimax estimator of ©. 

Remark 4. 2. 1 ; An alternative expression for ^p, as given below, 
can be obtained making use of the relations (4. 2.5) and (4.2.17). 


^pU^ = 


^D*(u) 

9 rx* / \ 9 r^* / \ 

X2 + -3^1^ D (li) - ^ D 


^-1 




* / A 3 

° ‘-sl - 


* / X 

D (u) 


k-l 




+ D* (u) 


^-1 


(4. 2. 21) 


The Mixed Estimators 


In Chapter 3, we studied fch# mixed estimators for estimating 
ordered means of two independeijf , variables both vAien 
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they have equal variances or unequal variances. However, the mixed 
estimators can be introduced for- any number k of normal populations. 
The result for k = 2 can be used in steps to construct the mixed . 
estimator for k > 2. In general we have the following result. 

Thepr^ 4 , 2 _. 4 ; If 6 (X) = (6^(X) 6^(X) ) is an estimator of 9 

such that 

^0 • ^ ^ 25 ^ S ■£ • • • jS ^ I for some ^ 

a mixed estimator of ^ can be constructed, viiich improves 


Proof : For convenience we take k - 3 . For k > 3 we have to repeat 

the argument. Consider the following subsets of R^, 


*= {X* < ^ 2 ^^^ - *53 ^-25^ ^ ' 

^2 “ ^ < 63 (x) < 62(35) 1 * 

^3 = <52^2?^ < 6j^(x) < 63 (x) 3 ^ 

= { x* ^2^— ^ < 5j^(x) } , 

A^ = { X* 63 (x) < 6j^(x) < 62(3?) 3 / 


and Ag = [ x: ^^(x) < *2^-^ ^ ^ * 

6 

The sets A,, 1 = 1 ,..., 6 are disjoint and Pg((^ A^) =1 
^ — 1 = 1 . 

for all © G Qq. If Pq,(A^) < 1 for some ©’ B Q^, we have P^, (A^) > 0 
for at least one i = 2,..»,6. bet, for example, P0i (^2^ ^ then 
we can use the constnj.ction of Lemma 3 . 3 . 1 to "Sfet an estimator 
( ,^,62,63) satisfying 6^(x) < Cj^x) < ^^Cx) over A2. In a similar 



Finally, we get an estimator 
<54(55) < < 5 l(x) with 


lying in the space {©: S 
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Remark 4. 
minimax. 


_2_j_2. Consider the mixed estimator of X. 
the mixed estimator is also minimax. 


Since X is 


* The risk function of the mixed estimator is compli- 
cated even for k = 3 and comparison vdth ^ is difficxalt to make. 

Remark 4. 2, 4: By an argtiment similar to that in Theorem 3.3,5, 

we can show that the mixed estimators are not generalized Bayes 
and so are inadmissible. 


Some Alternative Estimators 


Let X^* • • • i2?n random sample from a p-variate normal 

distribution with mean vector 9 and the covariance matrix identity 
matrix. For estimating ©, let the loss function be the square of 
the distance between the parameter and the estimate. The usual 
estimator, the sample mean X is the best translation equi variant 
estimator of ©. For pal and p ■ 2, X is admissible. However, 
Stein (1956) proved the inadmissibility of X for p > 3, a sxirprising 
result in view of the fact that the components of X are independent 
and the loss in estimating 9 is the sum of individual losses in 


estimating ©^'s. Brown (1966) considered location parameter densi- 
ties and general loss functions. He proved under mild conditions 
that the best translation equi variant estimator is admissible for 
p = 1 and 2 and inadmissible for p > 3. 


For the problem of estimating two ordered location parame- 
ters we know that the Pitman estimator ^ is admissible under some 
conditions of finiteness gf wtien the loss function is 

squared error (Blumenthal'<&^vf^ft Tiieorem 4. 1) . It 




would be interesting to see 


p l«s have more than 
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tvjo populations. The resxilt of Brown (1971, pp. 898-899) proves 

that for the problem of estimating k ordered normal means the 

Pitman estimator is inadmissible for k _> 3, although he does 

not provide a better estimator. In this section, we consider the 

case k = 3. We show that ■ X + “^(X) is admissible among its 

multiples and derive a necessary and sufficient condition for 6 

-P 

to be admissible among estimators of the form X + c l(X).ca cons- 
tant. We also suggest some estimators vAiich may possibly improve 


When k « 3, we have X « (X^,X 2 ,X 2 ), e = ( 8 ^, 02 , 03 ); p(x/®) 
and Q of (4. 2. 2) are given by 


p(x/0) = 9(Xj^-0^) ?(x2-02) * 

and Qq — = ^^ 1 *^ 2 *^ 3 ^ * ^1 “ ^2 “ ^3 ^ * 


(4. 2. 22) 


Also D(x) = I 9(x^-0^) <P(x 2 - 02 ) f(x 3 -e 3 )d©^ de 2 de 3 . (4.2.23) 

Using the identities (3.3.14) and (3.3.15) and simplifying. 


we get the of (4.2.3) as 

aj^(x) = - Qi(x) » 

a2(x) = Qi(x) - ' 

and a 3 (x) “ 02 ^—^ ' 

^ ^l”^2 ,^^3''^l”^2x 

where 03 ^( 3 ?) =72 ^ ^ ' 


(4. 2. 24) 


(4.2.25) 


and 
Therefore, 


^ x„-x, 

Q2(x) = 72 ^ ^ 




6 ^(x) = X + J(x) , 


(4. 2. 26) 
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where. 


r(x) = 


-Q 3 ^(x)/D(x) 

(Q^(x) - Q 2 (x))/D(x) 
Q 2 ^ 2 ?) /O ^ 2 ?) 


(4. 2. 27) 


A usefiil technique for improving upon estimators is by 
Brewster and Zidek (197 4). An application of the technique leads 
to the result that is admissible among its multiples. 


Theorem 4.2,5 ^ Among the estimators c , c a constant the only 
admissible estimators for the squared error loss are given by c 6 ^, 
vAiere 0 _< c ^ 1 . 

For a proof of the above theorem we need the follovdng 

lemma. 


Lemma 4. 2. 6 : Let D{x), Qj^(2S^ ^ind 02^2?^ t)e as defined in (4.2.23) 

and (4.2.25). Then 

Q?(X) + q 3(X) - Q.(X)Q,(X) QiCX) 

^ -- ^ ^( x^-x,) 5^3^ ^ (X3-X2) 5^1 


D'-(X) 

□ .(X)' 

® dT3^ ® dTxT * 


Q 2 U) 


(4. 2. 28) 


Proofs Define 


^ x^-x-, 1 2xo“X.-x„ 


' X„-X- . X 4-X3"2x 

_i cp ( ---) — 9 (— ^ — 7 ? — ^ • 

V2 ^V /2 ^ ^ '^6 


( 4. 2. 29) 


Then 


3Q^(x) ^ 2"^1 


3 x. 


= ^ -o — ) Qi^2S) - * 
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3Q-I (x) 


x,-x. 


and 


3X2 

- ( n 

^ 2 ‘ 

Oil 

- P(x) . 

3 Q 2 (x) 


Q 2 ( 2 ?) 


3 x 2 

■ < 2 > 

+ P(x) , 

302 ( 2 ?) 

3 x 3 

X -X 

_ (_i — 3. 
2 ’ 

Q2(x) 

+ P(x) . 

we apply Lemma 4. 

2. 2 to 

evaluate © 


(4. 2.30) 


0 


Q2(X) 


Ql(X) 

d(x) 


j ® D (x) ' ^ 


®1 ^ ^ D (x) 


Q.(X) Q^(X) g Q^(X) 


-) = E{X 


1 - 75q mw 


) 


r 1 f Q?(X) 

= ^‘■dTI^ Q (X) - ((-^^) Q (X)-P(X)) } - -i ] , 

D^(X) 


(4. 2. 31) 


Qj^(X) 


X - a Qi W 

®2 ^^d(x) ^ = ^^^2 51x5 ■ 33^ b(x) ^ 

x.-x. 


= ^^dTx)" 

Qj_(X) (Qj^(X)-Q2 (X)) 


D^(X) 


■] 


(4. 2. 32) 


Q2(X) 


Q2(X) g Q2^X) 


®2 E (5 (x) ) = ® dIx5 3X, d(x) ^ 


1 

CX2Q2iX> - ( Q^U) +p(3p) l 


Q2(X) (Qj^(X)-Q2CX)) ^ 

.] , 

D (X) 


(4. 2, 33) 


and 


Qo(X) 3 ^2^^^ 

®3 ® ( X) ^ “ ^^^3 D{X) “ 33^ D(X) 


“ e[-^ U3Q2(^; v +^i^] . 


D^(X) 


(4. 2. 34) 



subtracting (4. 2. 31) from (4.2.32) and (4.2.33) from (4.2.34) and 
then adding the resulting identities we get (4.2.28), as was to be 
proved. 


Proof of Theorem 4.2.5 : The risk of c 6 is 

-V 

R(0, c _^p) = Eq I c ^-0 1^ = h(c,0), say. 


Notice that for fixed © risk is a convex function of c. The value 
of c minimizing h(c,e) for fixed © is a solution of h(c,e) = 0 
and is given by 

^ Eq(©i 5p2 + ®3 

c(B) = 2 2 ' 2 

'^p2 ‘^ps^ 


Q^(x) 


Q^ (X) -Q2(X) 


- dT 3^^ ^ ®2^(^2 * - D ixy - ®3^^^3 + 


Q2(X) 


QlTX) 


^^^1 - dTxT^ 


Q 3 ^(X)-Q 2 Cp 2 


^2^-^ V 2 




3 2 Q,(X) 

©I + (©2-®l> ^ dT#- ^ dIxT 


3 2 ^Q'lU) ■Ki2^X)-Qj^ipQ^iX) (X^-X^^) Q^(X) +(X3-X2) Q2(X) 

+ E e^+2E[ 9,^: dT15 ^ J 


D"(X) 

o Q.(X) Q^Cx) 


® D(X) ^®3 ®2^ ^ D(X) 

T Q.(x) oTixy * 

^ ^ . f N 'r» \ TT — 


3 + E 0^ + (©2-0 J^) E Q^x) ■*■ ^®3"®2^ ^ D(X) 

i=l - - , 

The last j^equality follows from Leiwna 4.2.6. 

For ©1 < 0., < ©o we have 0 < ciQ) <1 and c(9) approaches 

one as appro ach*d infinity along the line ©^ “ ®2 “ ®3* 

Inf c(©) = ^(0) » 0 and Sup c(0) = 


© e 0, 


e £q 


Hence 


1 . 
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Any value of c in the interval [o, 1) is a c(0) and so 

minimizes the risk at some ©. Therefore, such a c6 is admissible 

“P 

among multiples of 6 , Also cfi , c < 0 is improved by 0 and e6 , 

F P — ""P 

c > 1 is improved by ^ . 

P 

Next, we prove that 6^ is admissible among c<5 . 

P — p 

Cq 5.p, 0 < Cq < 1 satisfy 


-p^ - ®1 < ^2 ®3 • (4.2.35) 

Consider R(0/q6p) 

= Eg I cip-e 1^ 

cQ.(X) 2 c(Q, (X)-Q- 5 (X) ) , 

= E(cX^ d"(x) E(cX2 + — - © 2 ) 

cQ2(X) 2 

+ £( 0 X 3 + 63 ) 

= E(cX^-©^)^ +E(cX2-©2)^ +E(cX3-©3)^ 

CQ.(X) c(Q. (X)-Q 2 (X)) cQ 2 (^) 

+ 2E[- (cX^-©3^) d(x) d(X) “ (cX3-©3) ^ ( x) 1 

, Qt(X) + Q?(X)-Q. (X)Q„(X) 

+ 2c^ E(-i-^= ^ 1 - -.. g .... - .) 

D^(X) 


□ ^(X) 


Q2(X) 


= 3c + (c-1) - 2 c[(©2-®i)E j3(x) (® 3 “® 2 ^^ D (x) ^ 


9 r - 

+ 2c^ e[ ^^3-VdTx5 


D^CX) 


3 o o 

= 3c^ + (g-1)^ S ©^ * (c -2c) [{02-6 j^)E | 3 (x) ■*■ ^®3”®2^^ D(x) 

i=l . “ 


by Lemma 4. 2. 6. 


2 (X) Q 1 ( X) +Q 2 ( X) -Q 1 < P ^2 1 
/vv“ + — "o' — — j 

02 ( 2)3 
IxT-* 

( 4 . 2 , 36) 
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Comparing (4.2. 21) with (4, 2.26) and (4.2. 27), we have 
D* (u) = Q^(x) and 3 ^ D* (u) =Q 2 (x), 


and so from (4. 2. 19) , 

R(e,^p) = 3 - (02-0 ^)E - ( 63 - 0 2 ) E 


Ql(X) 


Q2(X) 


(4. 2. 37) 


Substituting from (4. 2. 36) and (4.2. 37) in (4.2.35), we get 

2,^222 2 r . 

3c 2 . (c^-1) 02 . (e2-2c^) [ (02-e,)E . (e3-e2)E 

< 3 - [( 02 -©j^)E 5f^y~ + ( 63 - 62 ) E 5 f^y~] for all S ®3 • 


When ©2 = ®2 “ ®3 ” ®' say, the above inequality takes the form 

(4.2.38) 


+ (c - 1 )^©^ < 1 . 

00 — 


The left hand side of (4.2.38) approaches infinity as © -* <» whereas 

the right hand side is simply one, thus giving a contradiction. 

Hence, 6 is admissible among estimators of the form c5 . 

P ^ 

Remark 4. 2. 5 : On any compact sxabset Q* of we can improve upon 

6 bv c *6 , vAiere c* = Sup c(©) < 1. This is so because 

-P ”P 0 £ 0* 

R(e, c^p) is a convex function of c. 

We employ the Brewster- Zidek technique on estimators of the 


form 


d (X) =5 X + s 2^2?^ ' ^ ^ ^ ^ ^ ^ ^ 

and' obtain a sufficient condition for inadmissibility of 

The risk function of dg is 
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= E I X + s r (X) - 0 l‘ 


El 


x-ei^ + 2s E[(Xj^-e^) r^U) +(X2-02) 


+ s^ E I r(x) 


which for fixed 0 is a convex function of s. The value of s mini- 
mizing R(9/d ) for each © is . 


e[ (©^-x^) -y^Cx) + {Q^-x^)y^{x) + (©3-X3)'>'3(x)] 

(0) _ I s ^ s— 


^ Q^CX) + Q^Cx) - Qi^2S)Q2^-^ 1 
2e[ -y— -] 


D^(X) 


1 

2 


[1 {- 


( (e2-0j^)E 


Q^U) 


Q2(X) 


'd(x) D(X) ^ 


E( 


qJ(X) + Q2(X) - Q]^(X)Q2^2S^ 


1 ] 


D^(X) 


■) 


by an application of Lemma 4*2*6, 


Clearly, s(0) > for all < ©2 — ®3 ^(©) * 2 » 

© G Qo 


which is attained at 0. » ©^ * ©o* We do not know what Sup s(e)= J 

^ °o 

say, is. However, improvement over §^(X) is possible if s < 1. 


The dominating estimator wDuld be d_. Thus, we have proved the 

s 

following result. 


Theorem 4. 2. 7 • The Pitman estimator 6^ is inadmissible among 


estimators d^(X) = X + s I(2P if and only if s = Sup s(0) < 1. 
-s — ©to. 


' w ■ ■■ 

Also estimators dg(X) for s < \ are improved by d^y 2^^^ * s < 


the estimator dominating is X + s J(X) • 


The technique of Brown (1979) for improving the estimators 
i^ described in a subsection, of Ch^|>ter 2. We employ this technique 
j^Q scale an impirovcmcnti 


•• ;;i # - 


.i' J, t J' ' ‘ 
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Consider an estimator i(X,X) - ^ (x) + x(x), 

where 

X^(x) 

XaCx) 

and let 

A{e) = R(e,^p) - R(e,5.(\)). 

If there is a \ for ■which A(0) _> o for all 0^^ ^ ®2 — 
the corresponding estimator §.(X) will be better than 6 . However, j 
it is difficult to guess such a X in geneiraLL# Brown suggested I 

approximating the risk difference by means of Taylor series expansion! 
and obtaining solutions to the approximate equations. In Chapter 
2, we developed such an approximate formula for the three-dimen- 
sional case. The expression (2.6) on p, 42 obtained there, is 
of the form 

0,(0) Q/(©)-Q2{©) 

A(0) = -[2(X^^(©) + X22^®) + ^33^®^ “ d(©) ^ d(0) ^2^—^ 

( 9 ) 9 9 2'i 

+ 545 ^X 3 ( 0 )) + X^(0) + X 2 (©) +X3(0) J , (4,2,38) 




X^j denoting the first order partial derivative of X^ with respect 


t o Xj . 

choice 


ax ■ ■ ■ 

If we take X{x) = ns, with 0 < a < 2, viiiai is the 

!xl 

for James- Stein (1961) estimator, then A{©) > 0 for all 


0 . <0, <0-,. However, the error terms, in reaching the approxi- 

mation (4.2,38), are complicated and we are not able to show that 

. ■ ■ • ■ , . '■ age- 

they are negligible. Still we feel that 6 (X,X) with X( 2 c) = - 
improves upon (X) , 



Another approach to obtain a possible improvement is through 
empirical Bayes considerations. Efron a«l Morris (l97 2a) showed 
that the James-Stein (l96l) estimator of a normal mean vector is, 
in fact, an empirical Bayes estimator. In subsequent papers, Efron 
and Morris ^1971, 197 2b, 197 3a) considered various empirical Bayes 
procedures and showed that these procedures have fairly good risk 
p6irfoiniia.n.ccs vjhcn cotnpaired to tho usual estimators* Motivated by 
this fact we obtain an empirical Bayes estimator for the problem of 
estimating three ordered normal means* We considered a truncated 
normal prior given by 


e. 


(4. 2. 39) 


When c is known, we can easily find the Bayes estimator. However, 

2 c . a N + 

!xr 

get an empirical Bayes estimator 


when it is unknown, we estimate k^ = - - - — a > 0 to 


= 


2 Q?a^^^ 

k;'Xi — ~ — 

° ^ D°(X) 

a 

^ 

° ^ D°CX) 

S'** 

2 Q2a^^^ 


(4. 2. 40) 


2 , , a > + 


k;- = (1 - -^ 2 

° IX r 


) . 


vhere 
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Q°,(x) 


k k 

72 'PCtI (x^-x^)) $(^ {x2+X3-2x^)) , 


and D^( 2 c) = - ^2 - ^ 3 ^ 

vith Z. s independently distributed N(lc^x. ,k^) ranioni variables. 

O 1 o 

For this estimator also the risk expression is too compli- 
cated to be compared vdth the risk of 6 . It would be worth 

~P 

studying this estimator in detail as an alternative to 6 . 

“P 


4 . 3 Estimation of Components 


Nonminimaxity of the Pitman Estimator for 9 ^ ^ and Q j 

Let and be independent N(ej^,T) and .N( 02 /l) random 
variables respectively with < ©2 and x a known constant. For 
estimating ©2 vdth squared error loss the component 6^2 of the 
Pitman estimator 6 ^ has been shown to be minimax (Cohen and 
Sackrowitz (l970. Theorem 7.1)). This implies the minimaxity of 
the. component for 0 ^^ as seen belowJ 
The transformations 

X X2 

^1 ■* ^1 “ “ ^2 ■* ^2 “ “ ^ ' 

induce the following transformation on the parameters, 

®1 ' n ^ 

®1 “^1 = ■ 7 t ^2 “ ■ vTt • 

we have > TI 2 and Var(Y^) - 1, Var(Y 2 ) ^ lA- Then the component 

of the Pitman estimator for estimating is minimax and is given by 

5*(Y3_,Y2) 




1G5 


where v(.) is as defined in Remark 3 . 3 . 5 . 

Now 6 is minimax for if and only if -/t 6 * is 

minimax for But -Vt 6 is the component 6 pj^ of the Pitman 

estimator (see (3.3.4)), hence the result. 

Notice that this also proves the minimaxity of the Pitman 
estimator for estimating with squared error loss. 

Next, let X^, X^ and X^ be independent N( 0 ^, 1), N(e 2 , 1) 
and N(e 2 ,l) random variables with- _< < e^. We prove that the 

first and the third components of the Pitman estimator ^ are not 
minimaix for estimation of and ©^ respectively. This is a depar- 
ture from what Cohen and Sackrovdtz (1970) have proved for k = 2 
and vhat Brown (1979, p. 988) asserts about the minimaxity of the 
last component for any k. 

First, we give a lemma to be used in the proof of the non- 
minimaxity result. 

Lemma 4. 3. 1 ; Let D(x) , Qj^(x) , 02^-^ as defined in 

(4. 2. 23), (4. 2. 25) and (4.2.29) respectively. Then for all x, we 


have 

(i) 

^ ( X 2 t ■" 2 X 2 ) 02 ( 2 ?^ 

+ P(x) > 0 , 

(ii) 

|( 2 x 3 - x^ - X 2 ) Qi(x) 

4 - P(x) > 0 , 

(iii) 

Q 2 (x)- 2 Q 2 ^(x) 
^2 “ - D(x) 

and . 

(iv) 

1 

Q^(x)- 2 Q 2 (x) 


^3 " ^2 - D(x) 

/• 

’■ ■ ■ . V ' 

Proof 5 

( 1 ) |Cxj + X 3 - 2 x 1 ) 
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1 ^2"” ^3 

— ± cp ( — ± — £ 

V2 n/2 


\ r 1/ x^'4'X^"' 2x- 

) [ 5(x2«3-2Xi) H-2-^ 1) + ^ 


X-+x^-2x- 
q )(_2 3 Iv 1 


which is always nonnegative as T(y) + yf(y) > 0 for all y. The 
proof of (ii) is similar. To prove (iii) and (iv) , notice that 6 ^ 
is the generalized Bayes estimator of 0 with respect to the uniform 
prior restricted to 0^^ ^ 0 ^ jc ^ 3 * Therefore^ we have ^p3^ 

which proves (iii) and (iv) . 

Theorem 4.3.2 . The component 5 p 3 of is not minimax for estima- 
ting ©3 with respect to squared error loss function. 


Proof » From (4. 2. 26) and (4. 2. 27) , 

02 ^) 

^p3 “ ^3 D(Xy” * 


Define *= Xj^-X 2 , ^^3 “ ^l’*‘^2‘'‘^3* 

V 3 are independently distributed. We have = ■j(-Vj^+ 2 V 2 +V 2 ) and 
(X 2 +X 3 - 2 X^) = (V 2 - 2 V^). Also define ^2 “ ®3“®2 

V 3 = ®i'^ 2 '*^ 3 * risk difference 


A(©) = R(©,X3) - R(©,6p3) 




= E(X 3 - 03 )^ - E(X 3 + - © 3 ) 


= - E 


Q2(X) 




- 1 ^ - 2E(X3-03) 5 ^ , 

D^(X) - - 

Independence of (V^,V 2 ) and V 3 then yields 


A(e) 


o2(x) ^2^^^ 

- E -1-^ - I E t (2V2-Vj^2>»2+Vi> 


D^(X) 


Substituting for E —5 

D' 


^ ' - from ■’ 




illAj V 
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= e[t^ ( 


5 W - P<X) +i( 2 V 2 -Vj- 2 v 2 +Vi) Q,(X))] 


2 „ r , Q ^ ( X) 

3 [ (2V2-Vj-2v2tVj) gig-] . 


( 4 . 3 . 1) 


Simplifying ( 4 . 3 . 1 ) we get 


1 Qo(X) PCX) 

A(e) = - 5 Et(v,-2v,)5|j^, _ E(g^) . i( 


1, Q,(X) 

dIxT^ +3(263-9^-62) e(dX 3 ^) . 


At 6^ = 62 = 63, the last term in the above expression 
vanishes vbereas the sum of the first two terms is always negative 
from Lemma 4 . 3 . l(i). Therefore, the risk of 6^3 exceeds that of X3 
on 6^ ® ®2 “ ®3* been shown in Chapter 3 that X3 is minimax 

for estimating 63 for < 03 < 63 (Theorem 3. 2 . 3 ). Hence 6^3 is 
not minimax. 


Remark 4 . 3 . 1 ; Changing X^ to -X^^ and to -6^, i = 1 , 2 , 3 , it is 
clear that the component 6^^^ is not miniraax for 6^. However, we 

have not been able to resolve the minimaxity question of 6 for e_. 

IP ^ 

Since is a minimax estimator of 6, the proof of Theorem 4 . 3.2 
tells that 5p2 has a risk smaller than one in a ‘ neighboxirhood" of 


®2 = ® 3 - 


One must, however, prove the risk of 6^3 to be no 


larger than one in for it to be minimax. 


General Inadmissibility Result 


Let Xj^ and X2 be independent normal random variables with 
means 6^ and 63, 6^ < varianGes t and Irrespectively, t a 

known constant. Cohen and' Sackrowitz (197 0 ) considered estimators 
of 63 with respect to the squared erxor loss. They proved that any 
estimator 6(X2) , viiich is inadmissible when t = 1, r«nains so when 
T < 1 . Further, they prov^Ttl^t is; such that 6{X2)-X3 

is bounded above, than ^{X^) i;?!!; 

( 1971 ) it implies that ,an^,f^^ 


a result of Brown 
risk is 


mSR jDonna 
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inodini ssibl ©• Coh 0 n j ^ 

en am backrovdtz obtained a class of admissible 

estimators bas«3 on alone. This result was generalized to a 

general k. They also considered densities f(x-©^) and f (x-©^) , 

®1 — ® 2 * f is symmetric about 0 and loss function is strictly 

convex, say, W(|a-e 2 l) with W( 0 ) = 0 , they proved: 

Theorem 4.3.3* If f is o rv n. v \ v ^ ^ 

i- X3 aucn cnat > x^) > 0 for some © such 

that 6^ _< e^, and if there exists some estimator of ©^ vd.th finite 

risk, then X 2 is inadmissible. 

The proof of Cohen and Sackrowitz contains a minor error. 
The expression for A^+A^ on p. 203 2 should be 
-^2 -'02 

^ 2'*'^3 “ ^ Itl+t 2 l)-W(l t J-TI 2 I ) +W( It^-t^l )-w( lt,+ 0 „ 1)1 

— 00 —00 ^ ^ X X Z 

f(t^+t 2 ) f(tj^-t 2 )dt 2 dtj . (4.3.2) 

The result can still be proved by modifying argxaments of Cohen and 
Sackrowitz. 

When t^ < t 2 # the integrand in (4.3.2) can be written as 

[w(-t j^-t 2 ) -W(-t^ + 02 ) 4 W(t 2 -tj^)-W(-t^-‘n 2 )] f(tj^+t 2 ) f(tj^-t 2 ) , 

(4.3.3) 

since T)^ > 0. 

Define d^ = t 2 — t^^, d 2 ® "*^l”'^2* ^3 ^4 ~ ~^1~^2 

so that 0 < dj^ < d 2 < d^ < d^ and d^+d^ = d 2 +d 3 . W being a convex 

function, / 

W(d^) + wCd^) > W(d 2 ) + W<d 3 ) . ^ 

Hence the integrand (4.3.3) 4 ^ A 2 +A 3 is nonnegative vAien t^ < t 2 « 
When tj^ > t 2 and . 0 ^ > I, iiltwand in (4.3.2) becomes 
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> wc-t^^-t^) - Vii-t^+ri^) + w{0) - wc-t^-ri^) . (4.3.4) 

Take d- = 0, d- = d- = -t24r,2 and d4 = -t.-t^ so that 

Q ^ ^ *^2 — *^3 — ^4 = d^ + d^ . 

Once again convexity of W proves that the right hand side of (4.3.4) 
is nonnegative. Thus A^+A^ > o, vhich proves the result. 

The follovd.ng theorem extends Theorem 4. 3. 3 and also 
Theorem 2. 1 of Cohen and Sackrovd.tz, 


Theorem 4.3.4t Under the set up of Theorem 4. 3. 3 the estimator 
~ ^2 d.(X 2 ) is inadmissible for 02 » if a(X 2 ) is bounded 

above by a constant K for which Pq(Xj^ > X^+2K) > O for some e. 


®1 — ® 2 * 


X 1 +X 2 


X 2 -X^ 


Proof I Let ^ , Z2 = — ^ 


® 1‘^2 ® 2~®1 
^ , ^2 = "V^ ^ 0 ' 


In terras of new variables 6 (X 2 ) is 

6(Z^,Z2) = Zi + ^2 + a(2j^ + Z^) * 

By hypothesis there is some K such that a(Zj^+Z 2 ) _< K. 
Now consider the estimator 


6*(Zj^,Z 2) = + max(-K,'Z2) + a(Zj^+Z2) . 

Then 6 * is a better estimator than 5« The proof is similar to that 
of Theorem 5. 1 of Cohen and Sackrowitz (1970). 

Let us consider the risk difference • . 
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A IS R(6, ^2^/ ~ R (5 

= E W( 1 < 5-©2 I) - W( l'^- 02 ' ) 



-W(| z^+max(-K, Z2) +a( 2^+23) - 1 ) ] 
f (Z1+Z2- 'n^-Tl2) fiz^-z^-V^+rt^) dz2 dz^ . 

Making a change of variables = z^-t)^ and t2 = z^-n^, we get 
00 -K-TI2 

^ ” 2 / r [W( |t^+t2+a| )-W(|t^-K+a-T)2|) ] f(t^+t2) f(tj^-t2)dt2 dt^ 

( 4 . 3 . 5 ) 

2 

Define siobsets of R , 

= {{t^,t2) •• 1 1^\ < \, < - K - T)^} , 

©2 ^ {(bjl^/b2^* ^1 ^ *” ^2^ ^2""* ^ "* ^2 ^ ^ 

and S2={(t2,t2)it2^>'n2»t2<-K-'n2} 
and let 


=s / [ W( lt^+t2+Cil)-W(l t^-K+a-n2l) ] f(t^+t2) f (t^-t2)dt2 dt^ , 

Si 

for i = 1 , 2 , 3 . 

Then from ( 4 . 3 . 5 ) A = 2 (A^ + A2 A3). 

Now on we have ~il2 — ^2' ^2 — hence 

tjL+t2+a < 0 and tj^-K+a-T)2 < 0. So 

W(ltj_+t2+<il)— W(!t^-K+ar-7]2l) 
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Now 0 _< t^+K-a+T)^ < and since W is an increasing function, 

> 0 . 

Making a change of variables -» -t^ in and using 
symmetry of f, we have 

A 2 +A 3 = -^ b (t 12, o:,K, T)^) f(t^+t 2 ) f(t.-t 2 )dt 2 ‘^'t^ , 

— 00—00 

(4- 3.6) 

v^ere 


b(ti/t2/ cc,K, 7 ) 2 ) = W( It^+t2+cc|) - W(lt^-K+a^n2 l) + W( It2+a-t 1) 

- W( lt^+K-a+T52 1 ) . (4.3.7) 


On S2# tj^ < -^ 2 * ^2 — 
t 2 ^+a-K-'n 2 ^ 0 . 

We consider first t^ < t2+a- and then t^ > t2+a. 

(i) If t^ < t2+cc then t^+K-a+r^ _< ^^'this case b of 

( 4 . 3 . 7 ) is 

b = w(-t^-t2-a) - w(-t3_-riC-a+T]2) + w(t2+a-t^) - VJ(-t^-K+a-r)2) 

= VUd^) - W(d3) + W(d^) - W(d2) # 

w-here d^ = t2+a-ti. ^2 = -t^-K+a-T)2, d3 = -t^4^C-a+Ti2 and d^ = 
-ti-t2“a. These d^, ' s satisfy 0 < dj^ < d2 < <^3 < and d^+d^ 

b 4 <a = -2t.. Hence by convexity of W we have 

W(d^) + W(dj_) > W(d2V ■*■ ^^3) * 


(ii) 


or 


Tf t^ > t 2 +<x then either 
t^^ > a-ri2-K > t2+a 
a-V^-K > > t 2 +a • 

If ( 4. 3. 8 ) holds / ;h, , 


(4. 3.8) 
(4. 3.9) 



b = wC-t^-t2-a) - wC-t^+K-a+r]^) + W(t^-t2-a) - w(t ^-a+t^+K) . 
Now 

0 < + K - <^ + "^2 S ~ ^2 ~ ^ 

and 0<t^ - a + T) 2 +K<tj^-t 2 -a. 

Therefore b > 0, since W is an increasing function. 

If (4.3,9) holds then 

b = W(-tj^-t2-a) - W{-t^+K-a+T]2) + W{t3^-t2-a) - ■w(-t^+a-'n2-K) 

> W(-2t^) - W(-t3^-a4K+Ti2) + W(0) - wC-tj^-K+a-Ti^) 

= W(dp - W{d^) + W(dp - W(d^) , 
where 

d^ = 0, d 2 = -t j^-K+a-ri 2 * d^ = -t j^-*K-a+Ti 2 and d^ = -2t^ . 

Then 0 = d^ < d 2 < dj < <3^ and d^ *^3 = 

and by convexity of W. we have b ^ 0. 

This completes the proof of the theorem. 
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5. 1 I ntroduct ion 

Let X be a random vector taking values in a space tECI 
k 

R and have an unknov^n:! probability distribution in the family 
® ^ Ol . Assume that (? is dominated by a o- finite 
measure m. The problem is to estimate h(0), a measurable function 
on 0 into R . The loss function is taken to be squared error. 

Let the above estimation problem be invariant under a finite group 
G of transformations which preserve M. Under the assumptions that 
G, the group induced by G on the action space A is commutative 

4>o esj 

and the transformations g in G are linear, Moors (1981, 1985) showed 
that for each observed x, A can be curtailed to a subset such 
that any estimator 6# equi variant under G and satisfying 
P- (6(X) 0 A^) > 0 for some © in 0 , becomes inadmissible. The 
result leads to substantial reduction of the action space in 
truncated estimation problems where equi variant estimators taking 
values on or near the boundary of the parameter space become 
inadmissible. Moors also gave an estimator which dominates the 
in^missible one. In a recent paper. Moors and Van Houwelingen 
(1987) have proved the above result even when the elements of G do 

not preserve M and S is not commutative. 

In Section 5.2, we generalize the result of Moors in two 
directions. first, in piece o£ a finite group, »e take G to be a 

locally compact 

commutative and a' ^ 
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group of linear transformations. The subspaces of A are 
defined accordingly. Next, we take the loss function to be any 
strictly increasing function of the distance between the estimate 
and the estimand. sufficient conditions are obtained so that any 
G-equi variant estimator, taking values outside with positive 
probability becomes inadmissible. We notice that, for a compact 
group G, one of the conditions, (5.2.6) always holds. Further 
when the loss function is squared error, the condition (5. 2. 11) 
holds with the compact subset H as G itself. Also, for G compact, 
we do not require <5* to be commutative. However, the condition 
that the elements of G be measurepreserving cannot be relaxed. 

Various applications of the above inadmissibility resiHt 
are given in Section 5. 3. For estimating means and 
independent normal populations, we take the group of transforma- 
tions as the group of all the rotations in a plane. Theorem 5.2.7 
leads to the conclusion that any G-equi variant admissible esti- 
mator and so admissible, must take values in the quadrant, in 
vrtiich the observed x lies. Vie also consider the estimation of a 
bounded normal mean and a binomial probability of success with 
respect to a quart ic loss function. The condition (5. 2. 11) for 
Theorem 5.2.7 is seen to hold. Estimation of two or more ordered 
parameters when the underlying distributions are normal or bino- 
mial is also taken up. 

5.2 The Inadmissibility Result . 

bet X be a random vector taking values in a space ^ ^ R 
am have an unknovT, probability distribution Pg, eE Q, the para- 
meter space Qa subset of Rt , bet the family of distributions 
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f? ^ ® £ Q3 be dominated by a ^finite measure M and the 

density of with respect to m be t(xio). The problem is to 
estimate h(0), h a measurable function on Q into r’^. The loss 
function is 

L(e,a) = W(lh(G)-a!) , (5.2.1) 

where W is a strictly increasing function with W(0) =0. 

Without loss of generality, we take the space of possible 
estimates to be , the convex closure of h(Q) = {h(0) : © G Q} 

(see Lemma 3.3.2 for a justification). We also assume that h(Q) 
contains an open set in R^, 

Let the estimation problem be invariant under a locally 
compact group G of measurable transformations g^ 56 ^ , vhich 

are measurepreserving, that is, 

M(g"^B) = p(B) (5.2.2) 

for all measurable B C 9G and all g G G, and let the elements g 
of G, the group induced by G on the action space, be of the form, 

g(x) = Bx + c , (5.2.3) 

where B is any nonsingular matrix and c a vector. G is thus, a 
subgroup of the affine group of transformations. We also assume 
that G is commutative. 

Before giving the inadmissibility result, we state some 
lemmas. These will be helpfxil in the proof of the main theorem. 

Define a function g^ vA *• isometric, if g 

preserves the distance between any two points in , that is, 

= la-b I all a,b G ^ 


I g (a) -g(b) 1 


(5. 2. 4) 
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Notice that this delinition is different from the one 
considered by Moors (1985). who defines isometry as the property 
lg(a) I = lal for all a £ A. However, the statements and the 
proofs of the lemmas and the main theorem of Moors hold even with 
this modified definition. 

Lemmas 5.2. 1-5. 2.6 are from Moors and are given for the 
sake of completeness. The proofs of Lemmas 5.2.1, 5,2.3 and 5.2.4 
are modifications of the proofs given by Moors, in view of the 
fact, that the loss function is any strictly increasir^ function 
of the distance and G is a locally compact group of transformations, 
not necessarily finite. 


Lemma 5. 2. l i for the G-invariant estimation problem defined 
above, 

(i) h(g(G)) = g(h(0)) for all 0 £ Q, and 

(ii) g is isometric, 
for each g ^ G. 


Proof i Since the estimation problem is invariant, we should have 


for g £ G, ■ 

L(g(0), g(a)) ss L(0,a) 

for all 0 e Qand all a £ A , from (5, 2, 1) this ^ 

W( lh(g(©) ) - g(a)l ) » w(lh(0)"'at) 

for all 0 £ 0 and all a £ A • Choosing a = h(0) in the above rela- 

tion and using the fact that w' is strictly increasing, we get 

1 h(i(0)) - g(h{0)) I =0 for all 0 ^ Q / 

i.D'j no’W, is the same as in Moors 


which proves (i) • The": proo 

’ '.’V 

(1985,' p. 42). 


. y-'. 
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As a consequence of ti) we have G also a commutative 
group, since is so. 


L emma 5 ■ 2 . 2 • Jj'or a '^-invariant estimation problem, 

f(xiqCo)) = f(g ^(x)| 0 ) a.e. with respect to p, 
for each g £ G and all 9 £ q. 

Proof '• See Moors (1985, p. 43). 

Next, we define subsets of vA for each xG 3G. , as below: 
Consider the left invariant Haar measure v on G (see 
Chapter 2, p. 37 , and also Halmos (1952, p. 254)). This measure is 
finite on compact subsets of G, Thus we have 

v(H) > 0 for every H C G , (5.2.5) 

and v(gH) = v(H) for each g £ G and every H c; g. 


VJe assume that 

/ f(x|g( 0 )) dv(g) < <» • 

G 


(5- 2 . 6 ) 


For each x £ and 0 £ 0, define a probability measure a 


on G by 

a(x lg( 0 ) ) 


f (xla(9) ) 


/ f(xlk(9)) dv<k) 
G 


(5. 2.7) 


and functions h^: 0 - ^ for any fixed x £ 2£ by 

h (e) = / gh(e) a(xl5(9))av(g) . ! f (xli(9) )dv(g) > 0 

X • 


G 
h(©) 


if / f (xlg(9) )dv(g) = 0 
G 

. (5.2.8) 


The set A is, then defined as the convex closure of h^Co) = 
{h^(0) : 0 G Qi V : 

In Leraeas 5 .! 2 . s' ahi 'fePpJiB ^=te some properties of 

'v', • j S'' '*"> 1'' '‘(-'.tf- 








Lemma ,. 5. _ 2. 3 : The functions h^ defined by (5.2.8) satisfy 

'“^g (x) ^ “ g(h^(9)) a.e. with respect to p 

for all © 6 Q and each g £ G. 


Proof ♦ First, w'e prove that 

a(g(x)ig(©)) = a(xie) a.e. with respect to p 
for all © £ Q and each g £ G. 


By definition. 


a(g (x) I g(©) ) = 


/ f (g(x) lk(©) ) dT>Ck) 
G 

f (xl©) 

_-l - 

/ fCxIg k(9))dv(k) 
G 


a. e. with re 


from Lemma 5.2. 2. Since v is a left invariant measure, tr 
ming k -» gk in the denominator, we get 

a(g(x)lg(©)) = • — — - * a. e. with respect to p 

/ f(xlk{9)) dv(k) ' 

G 

and so we have (5.2,9). 

h / ^ (g(©)) = / k h(g(©)) a(g(x)ik g(0)) dv(k) 
g(x) G 

if f (g(x) I k(g (©) ) dv(k) > 0 

■ ‘ G 'a' 

= h g(0) / 

if / f(g(x)lk g(©))dv(k) = 0 . 

,■' ' 0 , 

'' '■ ■' ^ ' , ; A 

_ _ c T if-i't arid* GSe««tWcbi^^»^f' ^ 

By Lemma 5. 2, l(i) f. 


By Lemma 5. 2, l(i) i. 
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’^g(x) = ^gkh(0) a(g(x)li k(e))dv(k) , 

if ^ f(gxlg k(e))dv(k) > 0 

G 

= g h(9) , 

if ^ f(g(x)lg k{©))dv(k) = 0 . 

G 

Since g is an affine transformation, a satisfies (5.2.9) and 
ctCx lg(9) )dv(g) is a probability measure on G, we get the result.- 


Lemma 5. 2. 4 : For sets A defined above 

(i) A d. for all x £ 36 , and 

(ii) ^g(x) “ ^^^x^ ^ 


Proof » To prove (i) , we notice the result that if S is a convex 

subset of and Z is an m-dimensional random vector with P(Z £ S) 

= 1 and E(2) < 00 , then E(z) £ S (see, for example, Ferguson (1967* 

p. 7 4)). When / f (x ig(9) )dv(g) > 0, h (9) can be written as 
G . 

E g h(9) where the expectation is taken over g with respect to a 
probability density a(x |g(©) )dv(g) . Also P(g h(9) £ ^^) = 1 and 
A is convex so that h^(9) £ . Since A^ is the smallest convex 

set containing hj^(Q), A^ Cl xA • 

For a proof of (ii) , see Moors (1985, p. 44). 

Let S be a closed convex subset of R*”. The projection of 
a point. X £ r"" on S is defined to be the unique point € S such 


that 


I X -X I = Inf 


£ s 


is-x f 


Lemmas 5.2.5 and 5. 2.6 below state some properties of - the 
projections. See Moors ' U9852'|.p. 45-«) their proofs. 



X20 


L emma 5. 2. 5 : Let S be a closed convex subset of R*'' 

be the projection of a point x G r"' on S. If x 2 S, 


and let x 
o 


'V®' 


for ail s G S . 


L emma 5 « 2. 6 1 Let S be closed and convex and the projection 

of X £ R on S be x^. If g is isometric, the projection of g(x) 
on g (S) is given by g(x^). 

Now, we state and prove the main theorem of this section. 


Theorem 5. 2, 7 : Consider a G-invariant estimation problem with G j 

I 

. . I 

a locally compact group, the induced group G a commutative stab- 
group of the affine group of transformations and the loss function 

(5.2.1). Asstame that the conditions (5.2.2) and (5.2.6) are satis- 

' I 

fied. Then any G-equi variant estimator d, for v^ich 

PQ,(d(X) Z Aj^) > 0 for some e' G 0 , (5.2.10) 

is dominated by d^, where d^(x) is the projection of d(x) on 
provided there exists a contact subset H of G such that 

/ [w(lg h(e)-d(x)l ) - W(ig h( 0 )-d^(x) n] f(xlg(e.*)) dv(g) > 0 , 

^ ( 5 . 2 . 11 ). 

for all X G = (x: d(x) Z A^). 

Proof : The measure v is finite on con^jact subsets of G and so 

without loss of generality we can write v(H) « 1. Consider the 
risk function of d: 

R(©',d) = / w(lh(e')-d(x)l) £(xie')dM(x) . 

*• .■ . 

j j MX. v *4 d is constant on the orbits 

Since d is equi variant, the ri sic ox a is w* 

of 0’ . This implies ^ 
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R{e',d) = / R(i(0'),d) dv(g) 
H 


= / I W(lh g(0')-d(x)I ) f(x|g(0‘)) djiCx) dv(g) . 
H 56 


Leituna 5. 2. l(i) and an interchange in the order of integration 
gives 


R (0' #d) 


/ / W( ig h(0')-d(x)| ) f(xlg(e')) dvCg) djiCx) . 

^ H 

(5. 2. 12) 


It can be shown easily that d^ is also a G-equi variant estimator 
(see Moors (1985, p. 46)): By Lemma 5. 2. 6, the projection of 
g(d(x)) on 9(A^) g(d^(x)). By equivariance of d and L^raia 5.2, 4 

we have g(d(x)) = d(g(x)) and g(A^) - and so g(d^(x)) - 

dQ(g(x)). Hence an e^qpression of the form (5.2.12) is valid for 
R(0‘,dQ) also. Thus, 


R(e‘ ,d)-R(e' ,dQ) 

. / r [W(i5h(«-d(x)i) - m(i 5 h(«0-a^(x)I)] £(xli(e'))dv<g)dM(x) 

96 H 

-/ / [w(i5h(^)-d(x)l)- W(l3 h(6()-d^(x)l!] £(xl5(6'))dv(g)dM(x) . 

H 

vhich is positive by (5..2. 10) and (5. 2. 11). Ibis cospletes the 


proof of the theorem. 

remark 5.2.1 : The sufficient condition (5.2.11) above will be 

satisfied if for ea* xE there exists a such that 

/ [Wdg h(e')-d(x)l) - w(lgh(9')-d„(x)l)] a*(x,5(e'))d,(g) 


> w(iy^_ 0 .-d(x)l );,r 


(5.2. 13) 
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where a*(xig(e')) f (x | q(9' ) ) 

/ f(xl g(0‘))dv(g) 

H 

By definition x £ d(x)^ and so by Lemma 5.2.5, 

Since VJ is a strictly increasing function, the right hand side 
of (5.2.13) is positive for all x £ and so (5.2.11) holds. 


Remark 5. 2« 2 ; When the group G is coii 5 )act. the left invariant 
measure v on G is also right invariant and finite. The condition 
(5.2.6) is satisfied. In this case Lemma 5.2.3 can be proved 
without using commutativity of G or G as shown below: 




= / k h(g(e)) a(g(x) I k(g(e))) dv(k) , 

G 

if / f(g(x) I k g(e)) dv(k) > 0 , 
G 

= h g(e) . 


if -C f(g(x) I ic g(0)) dv(k) = 0 
G 


Using Lemma 5.2. 1(1) and identity (5.2.9), we can write 
(x) 


h_ / ^ (g(©)) “ / g g ^ 9 h(0) a(x I g k g(©)) dv(k) # 

G 

if / f(x| g k g(0) ) di»»(k) > 0 
G 


g h(©) » 


if / f(xi g k g(©)) dv(k) * 0 
G 


a. e. with respect to 

We transform k -» g 


the fact that v is v:.,, ^ 


in the above integrals and use 


invariant to get 
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=/ gkh{9) a(x |k(e)) dv(k) , 

if / f(xl k(e)) dv(k) > 0 
G 

= gh(e) , 

if S f{xl k(e)) dv(k) = 0 
G 

a. e. with respect to |i.» Since g is an affine transformation and 
a(x I k(9))dv(k) « 1, the proof of the lemma is con^lete. 

In the condition (5.2.11) the set H can now be taken to be 
G itself. In the proof of the theorem we can start with 

R(e',d) = / R(i(0'),d) dv(g) . 

G ■ 

Remark 5.2.3 : when G is contact and the loss function is squared 

error, we can easily verify that (5.2.11) holds. The left hand 
side of (5. 2, 11) with H = G is 

/ ( ifh(e')-d(x) 1^ - ig h(e')-d^(x) 1^) f(xi g(e')) dv{g) 

G 

» (|d(x) ^ - I d (x) 1^) / f(x lg(e»))dv(g) 

^ Q 

+ 2(d (x)-d(x))'^ / g h(e')f(x 1 g(eV))dv(g) , 

where y^ denotes transpose of the vector By definition (5. 2.8) 

CBXi KTit© the ahove e:xpressioii as 

= [|d(x)l ^ - |dQ(x)|^ + 2(d^j(x)-d(x))’' f (x I 5(e' ) )d»(g) ) 

. (lh (e')-d(x)i^- Ih <e')«r^(*) 4(xi gO'HdxCg)) . 

■■ (5.2.14) 
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This last expression (5.2.14) Is positive by Lemma 5.2.5, 
X £ and this proves our claim. 


■whenever 


2. 4 : when G is locally compact and the loss function 

is squared error, a sufficient condition for (5.2.11) to hold is 
that there exists a compact set H cz G for vhich h*(9') £ A for 

X 3C 

all X £ v^ere 

) = / g h(0' ) a* (x I g(e' ) )dv(g) . 

H 

Proceeding as in the previous remark we get the left hand side of 
(5. 2. 11) as 

I h* (e')-d(x) I ^ - ih*(e')-d^(x) 1^ , 
which is positive by Lemma 5.2. 5 for all x G 

Remark 5.2.5 : An alternative to the condition (5.2.11), tinder 

which the result of Theorem 5.2.7 holds, isi 

There exists a probability measure v on G such that 

/ [w(I g h(e’ )-d(x) 1 ) - W( ig h(e')-d^(x) I)] f (x 1 g(e’) )dv* (g) >0 
G 

for all x£ ^ 

For a proof start with R(0',d) = f R(g(0' ) #d)<i v ( 9 ) eud 

G 

proceed as in the proof of Theorem 5. 2. 7. 


Remark 5» 2. 6 : The general set up of G a locally compact group 

(not necessarily affine) such that G la a subgroup of the affine 
group Is probably only of theoretical Interest in view of the fact 
that M is usually iebesg’ue jor -oounting measure. The requirement 
that g preserves M severely lll*it(a,tfe? . choice of G. We have not 


been able to find. ° 
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not affine but g £ G is affine. Moors (1985) also in his examples 
takes G itself to be a subgroup of the affine group. 


Plications to Truncated Estimation Problems 


Example 5.3.1 (Estimating a restricted binomial parameter): Let 


X be a binomial random variable vdth parameters n and ©, 

0 £ (1-P,P) , -^ < P < 1 and let the loss in estimating 0 by a be 


L(6t9t) (O-a.) # 


The problem is invariant under the group G * {e,g vAiere g(x) = 


i-x and e is the identity element. G induces groups G = (e, gl and 


G *a ) on Q and respectively where g(0) = 1-0 and g(a) =* 1-a.j 

A G-equi variant estimator d(x) satisfies d(x)+d(n-x) = 1. This 
problem was discussed by Moors (1985) in connection with randomized 


response models for n = 1. 


We have 


f(x I'e) = (^) (i-e)’^"^ . x = o,l,2,....n 


and so a and h of (5.2.7) and (5.2.8) are 

•fV 


a{x 1 B) « 


0^( 1-9) 


0 ^( 1 - 0 ) + ( 1 -©) 


a(x 1 g(©) ) 


( 1 - 0 )^^-^ 


0 ^( 1 -©)“*** + ( 1 *©) ® 


x„n-x 
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To determine v« consider the follovdng three oases: (i) x < ■§ 
(11) X » -f and (ill) X > -S. When x < |, let r = -S - x and so 


h^(6) - 

C 1-9) 


e e (1-P,P) . 


It can be checked easily that h^(e) < 1 for all G e (1-p,p) vdth 

equality occurring when G = and so sup h (G) = -i. To 

© £ ( l-p,p) ^ ^ * 

deteriiiine the miniitiuro value of h (Q) we observe that h (o) is 

^ 9 G X 

positive for e < ^ and negative for G > -i/that is, h (G) increases 
for e varying from 1-P to j and decreases thereafter. Therefore 
h^(e) attains its minimum at G = P or 1-P giving 


Inf 

a e (1-P,P) 


h (9) . 

^ P + (1-P) ^ 


Hence vAien x < A. 


[ 


(l-p)p'^'’^^ + P(l-P)”~^^ 1 1 

pH— 2x ^ 2x 2 


In case (ii) , x = and h^(G) simply reduces to ^ for every ©. 

Thus A as f -i 1. Case (iii) can be treated as Case (i) and we get ■ 
X * 2 ^ 

A r 1 p2x-n-i-l ^ ^_p^2x-nH-l ^ ^ ^ 

^x -ll' p2x-n ^^^pj2x-n -I ^ > 2 

By Theorem 5.2.7 any admissible equi variant estimator d(X) 
shoxild satisfy 

1 


d(x) P r (1-P)p''~^'' t PCl- P^^'rif 1], if X < dCx)- 2 ' 
d(x) £ [ pn-2x ^ ^_pjn^2x”"' 2^ 2 2 


if X as and d(x) £ [■J- 


11- 


't 'P 


2 

2x-n+l 


iiS®i 




1 , if X 


2 • 


■ ’ V'\ rtis:-.''''’.--'' 'v.. ' 
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Exat"p3.e 5 ., 3...2 (Estimating a res tricted binomial parameter, n 1 ) : 

Let X be a Bernoulli random variable with © the probability of 
success, e e (1-P,P), i < p < Let the loss in estimating © be 

L (0t « (0-a)^ . 2 i) 

The problem is invariant under the group G =. {.e,g], vhere g(x) = 
and e is the identity element# G induces groups G == {e^g} and. 

<f%3> t%k * 

G « [e,g] on Q and ^ respectively, vhere g(©) » 1-e and g(a) * 1-a. 
A 0-equi variant estimator d(x) satisfies d(x) 4 d(l-x) = 1. We 
obtain sxibsets of ^ and show that the condition ( 5 . 2 . 11 > of 
Theor®m 5* 2.7 holds vd.th H = g, v the counting measure and the loss 
function given by (5.3.1). 

Taking n » 1 in Example 5.3.1 the subsets A^ of axe 

A^ » [2P(1-P), (5.3.2) 

and ' " - 

A^ « [i, P^+(1-P)^l . ' (5.3.3) 

We now verify condition (5. 2. 11) with H = G. Let x = 0 

and d(X) be an equi variant estimator with d(0) ^ A^. Let us 

first consider the case d(0) >- 5 . Then the projection <3^(0) of 

d(0) on A is •!. Writing a *» d(0) the condition (5.2.11) takes 
o * . 

the form 

((©_a)'^ - (©--x)^(i-e) + (d-e-a)^ - {i-e-|) )e > 0 

. 3. 4) 





3 P { 3, ^ 0 ) 

Now at a = 2 / = 4(-|- e)^(i-2e) > 0 for all e £ (i-p,p) 

a^P^(a, 0 ) gp 

and 5 > 0 for all 0 £ (1-P,P) and a. Thus — ^ > 0 for 

3a - -3a 

a > "2 and so Pj|^(a,0) > 0 for a > and 0 £ (1-P,P), thus verifying 

the condition (5.3.4). ' 

Next, we take up d(0) < 2P(1-P). In this case d (0) = 

o 

2P(1-P). Once again writing a for d(0) the condition (5.2.11) 
reduces to 


( (©-a) (0“2P(1-P)) ^) (1-e) + ((l-0-a)^-(l-©-2P(l-P))^)© >0 

(5.3.5) 

for a < 2P(1-P) and © G (1-P,P), Denote the left hand side of 
the inequality (5.3.5) by P 2 (a, 0 ). We notice ^hat P 2 ( 2P ( 1-P) ,0) = 


^ . l2(8-a)^(l-e) + 12(l-S-a)^e . 


Since 


> 0 for any a an! all e £ (1-P,P)/ we have -j 


^ ^-F A Thus we will be through if we can 

an increasing function of a. inus ws 

Show that at a - 2P(1-P) the 4* -|r^ 

e e ( 1 -P,P). for cohveni^ylll^'y^ 
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It can be sho™ easily that 0(e) attains its minimum value in 
(1-P,P) either at 6 = i or at e . P, 1-p. Now Q(i) . (i- 2P(1-P))^ 

> 0 for all P e (-j, 1) and. 0(P) . O(l-P) = P ( 1-p) ( 2P- 1) ^ > 0. So 

Q(0) > 0 for Q G (1-P,P). This completes the verification of the 
condition (5.3,5)* 

In a similar way, one can verify that (5.2.11) holds \*ien 
X » 1 and d(l) £ Thus Theorem 5.2.7 is applicable here. Any 

admissible equi variant estimator d must satisfy d(0) G [2P(1-P), "I] 
and d(l) e [j, 1-2P+2P^]. 


Example 5.3.3 (Estimating two ordered binomial probabilities of 
success) Let and X 2 be independent Bin(n,©^) and Bin(n,© 2 ^ 
random variables and 6^^ 02» Consider estimation of © = (©^,© 2 ) 

with the loss function the sum of squared errors'* 


2 

L(©,a) » |©- 5 I . (5.3.6) 

The estimation problem is invariant under group G = {e,g} vhere 

w— ' — isj ro 

g(x^.X 2 ) * (n-X 2 ,n-x^). G induces groups G * { e,g } and G = [e,gl 
on Q and ^ respectively, vhere g(0) “ (1— © 2 #l~®j^) and g(_a) = 
(l-a 2 f 1-aj^) . Thus we have gi^) « Ba+c, -hhere B = (_° "J) and 

c >« ( 1, 1) . 

' Here, 

n X ' n-x. n X 2 
^ ) ©^^(1-ei) ( ) ^2 

x^ ^2 

X » 0, 1, • . » » n, i = l, 2; 


We get 


a(x I ©) = 


^1 


Vi*',. V 1 '.-2v A A \ ^ 
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’^“^1 n-x. 


a(x 1 g(e) ) 


Therefore, 


( 1 -e ) ^l-ej 


e^^d-e^) ^e.^d-e.) 


S n-x. X., n-x- 

+ (1-62) ^02 ^(1-e^) ^ 


h ( © ) aa 
X 


X- 4*1 


^ ^ 2 . ^1+1 X- n-x. n-x- 

^ (l-ej^) 02 (1-^2^ ^ (l-Qj) ^©2 ^ 


X , +1 


.^ 1-^2 


ej ^"©2 ( 1 -e^) ^( 1 - 02 ) 


1 i.*“A. n— Jt 

e^^e 2 ^ d-Oi) (i-e 2 ^ ^+(1-02) d i-e^) 


Co X. X- n-x. n-x- 

* ‘l-« 2 > <l-®l) ®2 »1 


X 2 +I n-x^ n-X2 
®2 ®1 


X. X- n-x. 

©162(1-91) (1-92) 


c- X. X- n-x. n-x- 

* ®2 


Next we determine A^. Clearly, both the conqponents lie 
between 0 and 1 , As 0 i < 62# we have the first component in 
always less than or equal to the second component. There are three 
cases under consideration: , 

(i) Xi + X2 = n, 

(ii) Xi + X2 < n, and 

(iii) Xi + X2 > n. 

In case (i) , using X2 » n-Xi we get 


h^( 9 ) 


1 + 0 1-©2 
1402 - 9 i 


and so A^ is the line segment joining the points (0, l) and 2^ 

in the two dimensional co-ordipate plane. In case (ii), we write 


m = n-Xi-X2. Then 


h (0) = 

X ^ 


0ltl-02) ( (1“®1^ (^"^2^ "*^1 ^ 2 ’ 

\ n»- i / . ^ \ W . a®a®" I\ 
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The sum of the two components of h (e) is 

v(e„6,) 


Ci-6^)'"(i-S 2)"' + 9”e 


Now w(e^,© 2 ) < 1 is equivalent to 

i(^ich is true as 0 < e^, ^1. ^so points e « (0,0)^ (-1, -i) 

and (0, 1) correspond to the same points h^(©) in the plane and so 
is the triangle vdth sides given by the lines x * 0, x+y = 1 
and X »» y. In a similar way for case (iii) , is the triangle 
with the sides given by the lines y » 1, x+y = 1 and x = y. Thus 
we see that there is a substantial reduction in the action space. 
Theoran 5.2.7 is applicable as we have a finite group and the loss 
function is squared error. Any admissible equi variant estimator 
must lie in with probability one. 


Example 5. 3. 4 (Estimating bounded normal mean) : Let X be a normal 

random variable with mean © and variance unity, ©G [ -m,m]. Also 
let the loss in estimating © be (5.3.1). This estimation probl«a 
is invariant ui^aer g » {e,g3, idierc g(x) » -x. The induced groups 
are G » £ e, g } and G » {e,g}, viiere g(©) » -© and g{a) = -a. A 
G—equi variant estimator satisfies d{— x) « — d{x). Then h^ as 
obtained in Moors (1985, p» 49). is 


h^(e) 


Thus we have 


e T(x-e) - © 

T(x-©) + 9(x+©) 


© tanh(©x) 


A^ w' J V, 




if X > 0 


.jt:. 




■: . ■: u . 










(5. 3.7) 
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Now 


we verify condition (5.2.11) of Theorem 5 2 7 , . 

ineorem b. 2. 7. Let us consider 

the case x > 0 and d(x) < o. Then (d (vi n 

iuen a^{x) =0 and writing a for 

d(x) and G for H the condition reduces to 

((e-a)^ - 6‘‘)e®'' * (( 9 «)< . > o , 


(5. 3.8) 


Denote the left hand side of the Inequality (5.3.8) by P (a,e). 


Then P^CO^O) =» 0 and 


3a 

2 

3^P 


aa‘ 


« - 4(©-a)^e®^ + 4(e+a)^e"®^ 

- - 12C©-a) + 12(e+a)V®^ . 


3P. 


At a *■ 0# m -.4©^(e®^-e ®^) vAiich is negative for all 0 and all 

X > 0, Also — Y" > 0 ® and all a, so that < 0 for 

3a 

a < 0. This proves that P^Ca,©) > 0 for all 0 and a < 0. Hence 
the inequality (5.3.8) is satisfied for all a < 0 and © £ [-ro,ni]. 
In a similar manner, we can verify (5.2,11) for the other cases. 
Thus Theorem 5.2.7 is applicable and any admissible G-equi variant 
estimator must have d(X) G with probability one. 

Example 5.3.5 (Estimating k ordered normal means) : Let X 2 , 

be independent normal random variables with means 0 j^,© 2 , . . . 

®1 < — * * * — \ common variance unity. We estimate © = 

(©^,© 2 , . . . ,©j^) with the squared error loss function: 

L(©,a) » J©-al 

This estimation 9^^ G = Ce,g 1, 

where g ( ( x^, X 2 , . J r 
groups G » and ^ 


^ the same as G 


iH#iH 


,,, group G induces 

with G aad 
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Now 

f (x 1 ©) - f Cxj^-e^) 


<p(vV 


'P(x^- 0 l) ... 

a(xie) “ cp(Xj^-e^) ... + '(>(x^+e^) ... 

and 

f (xj^+e^) . . . 9 (Xj^+e^) 

a(xig(e)) - <j>{x^-e^V:.f(x^-@^) + 1>(xi4e^)...<P(xj^+e^y 

viieire y * ^ ^l^k ^ ••• ■*■ • 

Thus we get 


l+e 


-y ' 


l+e 


,y ' 


h (0) ■ 

2 S- dte'^) 



(l^eY) 



'k- 1 

If we denote the components of h^(e) by h^(0) , . . . ,h^(i> respectively, 
then h^(e) < ... < hNe) and so - l(d^, . . . ,dj^) : d^^ < ... < d^^}. 


we can observe more 


reduction of •A \Aien k * 2. In this 


C'9.S6 


V® - 713 ^ 


c;) 


( l+e^) 
2 , 


-a) 

-9^/ 


N M + h^(e) “ (ei+0o) (e^-e"^) , 

where y » (xdX2)(ei402)- Now h^(e) + 1 2 

4 - 1 ,^ or zero according as (x,+X 2 ) is positive, 
which is positive, negative or zero accu ^ 1 ^ 


negative or zero. Therefore, 





A =f { (d.,d2) •• <^1 < ^2 

*Ak 

and 

^1*^2 - 

0 ) , 

if 

X 1 +X 2 

= { (d3^.d2) : < ^2 

and 

di'*d2 - 

0 ) , 

if 

x^ *^^2 

= i (d3^*d2) : < d2 

and 

di-^2 “ 

0 } , 

if 

3^1 ■*■^2 
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The maximum likelihood estimator for this problem is 

^l/2(x) = ( ^) , if X. < X- 

1 

~ "5^ ) » if > x„ 

Xj^+X2 , 

(see Remark 3.3.4). It has been shown that is inadmissible, 

however no improvement has been obtained so far. Theorem 5.2.7 
also does not help us in improving _6(x) as it falls in the region 
A for each . 


Example 5. 3. 6 (Simultaneous estimation of two normal means) : Let 

and X 2 be independent normal random variables with means and 
©2 and the common variance unity. We estimate © = (©^,© 2 ) with 
the loss function (5.3.6). The problem is invariant under the 
group G of all rotations in the plane, given by 


G = G- IJ , where 


and 



cosa sina 
-sina cosa 
cosa sina 
sina -cosa 


-71 < a < n 


-71 < a < 7i| 


It is well known that G is a compact group. The induced groups G 
and G are defined in the same way as G. A G-equi variant estimator 

will be 




d(x) » X T(1 




Then we can' writ 


we taXe v to be unifew interval [-r,r]. 




cosa+u« sina 

2ti e ^ 

It co3b+U2 sinb v cosb+v^ sinb 

J U + e ^ ) 


and a(x 1 i-^Ce) ) 


2 % e 


co3a+V2 sina 


Tc u,^ co3b+u.„ sinb v. co^+v« sinb 
/ (e ■ - •'• ^ ' 


where '^2 ~ ^1®2~^2^1' 

’^2 “ ^1®2'^^2®1* 


Therefore 


h^(e) =2^ / Lg^ 
— -u 


' r- - -*• _* 

/ Lg (0) a(x 1 g (0) ) + 9=^®) 19=^®))] 


% u^cosa+U2sina v^cosa+V2sina 

/ (0^cosa+e2®i“^^ + e )' 

71 u.cosb+UoSinb v.cosb+v-sinb 

/(e ^ ^ + e ^ ^ )db 


u u^cosa+U2sina Vj^cosa+V2sina 

/ (-ej^ 3 ina-> 62 Cosa) (e -e )d 

-7C ;; 

71 u^cosb+u^sinb v. cosb+V2sinb 

/ ( e + e ) db 


( 5 . 3.9 ) 


Simplifying the right hand side of (3.3.9) and writing 


71 u-cosa 

I _ / e cosh{u23ina)da , 


J = / e 


71 v.cosa 

f e ■*■ cosh( V23ina)da # 


■n , n.cQsa . V- 

r onsa e cosh(u.o3ina)da . 


I. a: / cosa e 
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® cosa e 
o 


v^cosa 


cosh(v2sina)da , 


= / sina e 
o 


v^cosa 


sinh(v2sina)da , 


we get 


hx(e) = 


* ®2^2 ■*■ ®2'^2 
- 6 ji 2 + 


u, V- 

An integration by parts yields I and J. = — J„ and so 

A ' 2 ^ ^ ^2 ^ 

(0^ + eh I j 
- "(I + J) ‘■■q * ^>2 • 

^2 ^2 

It can be easily verified that 7 -^ and — are both nonnegative for 
all © and x» Also I and J are nonnegative and so 


A^ = {(d^,d 2 )* dj^ has the same sign as and d^ » 0 

v^ienever = 0 , i = 1, 2 } . 


(5.3.10) 


By Theorem 5.2,7 an admissible equi variant estimator lies in A^ and 
thus it should take values in the same quadrant as (x^#X 2 ). 


Remark 5.3.1 : Let the parameter space in the above problem be 

restricted to Oq = {( 0 j^/^ 2 ^ ’ ®l '^2 ^ ^ ^ this case A^ 

is the A of (5.3.10) restricted to q^. 
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.7 Location Pa rameter of Tvoo 

— wa.th Diff erent ScalTTa^;^;;^ 


6. 1 Introduction 

Let X _ and Y = (Y^,.,,,y^) be independent 

random samples from tw populations with densities -ji and 

Oy f( 0 ^) respectively, vAiere anci are unknot'fn encl possibly 

unequal. Let the density f be symmetric about zero. We are ‘ 
interested in the estimation of ©, tha cownmoi. iocatioi- paraiWvfcr. 
Available to us are unbiased estimators of 6 based on the indivi- 
dual samples and we vdll like to improve at least one of them by 
a combination of the two, Hoqq (1960b) suggested a method for 
combining the unbiased estimators from the individual samples, 
so that the resulting estimator is also unbiased. Let f and 

X X 

be odd location-scale and even location free-scale statistics 
(these terms are defined in Section 6.2) respectively, based on 2L 
Hogg (1960a) proved that and are uncorrelated. As a conse- 
quence of this result, Hogg (i960b) showed that the conditional 
expectation of given y equals 0, Thus, if and are odd 
location- scale estimators of © based on X and Y respectively, an 
unbiased estimator viiidi combines f„ arxi f is Wf„ + (l-W)'F . 

X y X y 

vAiere W is a function of even location free-scale statistics 


and Ty. 


Cohen (1976) discussed sopte situations vhere the problem 


of estimating a common 3 


two labor at or A 


arises. For eararople. 


' t - " ^ «• f '"I. 4' ‘.\'f f' . r’ '/ ( 
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quite appropriate to assume that the locations of the measured 
aspect of the product are the s^an,e, but the scales differ because 


Of laboratory techniques or facilities. The assumption on the 
distribution of the measured quantity could very well be a parti- 
cular location- scale family, or perhaps a finite set of location 
scale families. 

Cohen considered improving f or f when the loss function 

^ Y 

is squared error. He suggested using an estimator 6 and showed 

'9l 

th8.t b. simple moiuent condition^ ^ improves f for 0 < a < 

a (ntfii) 0 >?here a (m^n) is a constant depending on m and n only^ 

•jif 

He evaluated a (m, n) for specific values of m and n vJien the 
underlying distribution is uniform. 

Bhattacharyya (1981) showed that the above class of esti- 
mators dominating can be enlarged in the sense that there 
is an ACm^n) > a (m, n) such that 6^ for 0 < a < A(m, n) is better 
than ’f . The constant A(m,n) is easier to calculate than a* (m,n). 
Bhattacharyya tabulated values of A(m, n) for specific choices of 
m and n in case of uniform densities. It was observed that Cohen’ s 
bound a* (m#n) does not exceed one for both the pairs (m, n) and 
(n, ra) simultaneously for m * 2(1)15(5)50 and n = 6(1)15(5)50. 


However A(m/n) excasds one for m 25 vhen m — n and for both the 


pairs (ra/ n) and (n/m) for n _> 35 vhenever m ^ n+5. As will be 
seen later in Section 6.2 if the bound exceeds one for both the 
pairs im,n) and (n/in), the implication is that the estimator 6^^ 


with a = 1 dominates both and ty* 

■ In Sectiop giye. the general set 

up and the necessary Cohen and 
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Bhattacharyya are stated, in Section fi ^ ^ 

section 6. 3, we develop sufficient 

conditions under «hich the bounds, different from those of Cohen 
and Bhattacharyya, can be obtained. These conditions and the 
resulting bounds are given in Theorems 6 . 3.1 and 6.3.2. The 
bound obtained from Theorem 6. 3. i is simpler to evaluate than 
a*(m,n) and A(m,n). Houever, it does not always improve A(m,n). 
The bound obtained from Theorem 6.3.2 is alvmys larger than ACm,n) 
and also simpler to evaluate. For uniform distribution, we 
observe substantial improvements over A(m,n). If we denote the 
improving bound by B^U^n), it is seen to exceed one for both the 
pairs (m, n) and (n,m) for ro ^ 20, if m = n and for n > 32, if 
m _< n+5 compared to A(m, n) with this property for m > 25, if m = n 
and for n 35, if m _< n+5» Thus, we are able to prove the domi- 


nance of 6 a# over both and f for the values of m, n, for which 

Bhattacharyya shows dominance only over 

In Section 6.4, we consider another estimator ^ and 

c 

obtain conditions under vhich it dominates one or both of and 
I'y. The conditions are stated in Theorems 6,4.1, 6, 4. 2 and 6.4,3. 
An advantage in considering 6* is that we get a class of estimators 
including 6^, v^ich dominate both ^^d vhereas in Section 6.3 
we could have at most one estimator, namely dominating both 



Akai (1982) has also obtained a sufficient condition for 
minate W and 'F . His result is stronger than the one 
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In section 6.6, w consider estimation of the common mean 
M^of tvo normal populations vdth unKnown and unequal variances of an 

02- A commonly used estimator of p Is the Graybill-Deal estimator 
(1959) given by 

A S X + s,Y 

U = — £ 

^gd s, . ' 

v^ere X, Y, and $2 are the sample means and sample variances. 
Sinha and Mouqadem (1982) considered a class T of unbiased esti- 
mators of m; 


M “ 


X + (Y-X) iY-X)h , 0 < ^ _< 1 ! . 

They then obtained an expression for the risk of an estimator 
6 6^ and studied admissibility of iri various subclasses of 
. We consider improving in a subclass = { Ji: /l = 

X + (Y-X) f ( 3 ^, 32 )/ 0 _< ? _< 13 of C and derive a- differential 
Inequality using an identity due to Hudson (1978), A solution to 
this inequality will provide an improvement over Mqq. However, 
the question of the existence of a solution still rmains unres- 
olved. 

In Section 6.7, we consider the problem of estimating the 
common mean of a bivariate normal population. Let (Xj^, Yj^^) , . . . , 


(X„,Y ) be a random sample from a )» ( 

n a pa. 


ix -oj po^a^ 


M PO^a^ 




)) distri- 


bution with p unknown. Kri^namoorthy and Rohatgi (1988a) consi- 
dered estimators 


"UV 


23 (c) =^(V-cU — 




c a real constant. 
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■where U. = x.-y, . v - y ^.v ^ 

1 1 "i' "^1 - i = 1,2 n; 

n n 


U = 


2 

i=l 


U^ , V = I 2 


n 


i-l (u^-u) (v^-v) , 

in partlcvaar, they considered Aj . Mjd) and obtained the region 
of the parameter space .here M3 dominates the MLE Mj. We obtain 
a o such that ^3(0 ) has the largest region of dominance over Mj 
among estimators of the form Also we show that a reason- 
able choice^ of c is and has a larger region of domi- 

nance than p-y Further we obtain minimal essentially complete 
subclass of ^ real} and compare numerically the risk 

functions of ^2^ M3/ M3CC*). Once again, the choice 

is between ji^Cc*) and 

o n— 1 

6 , 2 Preliminaries , 

Let X = (X^, be a randoro sanple of size m from a 

poptilation with the density-^ f(^^), o > 0. Let Y = 
be a random sample, independent of X, from a popxilation with the 

1 X—© 

density f ( — —) , 0 > 0 , The function f is assumed to be symme- 

y y . 

trie about zero. The problem is one of estimating the coiranon 
location parameter e vhen the scale parameters and are 
unknown and unequal. The loss function is taken to be squared 
error. However, attention is restricted to the unbiased estimator 
of e and so the risk of any estimator is simply its variance. 

Further, we introduce invariance in the above problem. 

Let G be the affine groiflp bf transformations operating on the 
sample spacej.^ that 'is# ^ ' ' 
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We have then under g . : 

a, b ■ 

-* aX^+b , 1 » , 

Yj ^ aY^+b , j » 1,. . . , n , 

0 ae+b , 

0^ - 1 a 1 0^ aM 

Oy - 1 a I Oy . 

The estimation problem is invariant when the loss function is 

L{e,a) = (0-a)VoJ (6.2.1) 

-A. 

However# there is no change in the results, if instead of (6.2.1) 
we proceed with the squared error loss function. 

Let If be a G-equi variant estimator of 0. Thus# satis- 

*x* 

fies 


f^(axj^+b#...,aj^4b) f a ,3^) +b (6.2.2) 

for every real a and b. The statistics satisfying (6.2.2) are 
also called odd location-scale statistics, bet be even loca- 
tion free-scale invariant estimator of That is# satis 

r^(aX|+b#...#aXj^j+b) = |a} yjj(x^,...#Xjjj) (6.2.3) 



for every real a and b. 

Analogously 
Y- sample. 
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Cohen (1976) suqaesterf . 

suggested estimator 6 ^ for e defined by 

6 _ s (1 - -r^) « + - a ^ 

a 1 +z' ’x + T« 'fy . ( 6 . 2, 4) 

utierc a is a positive 

F ertive real. He proved the following result. 

Theorem 6.2.1 (Coh(=>n frQ' 7 c^^. . _ . 9 9 o 

unen Assume Eg(T^,Tph2( y) < «>. Let f 

be symmetric about 0 , and let 


*, , 2E t; k(V) 

a (m, n) »: i-yf , . 

E g(T‘,Tph^(v) 


( 6 . 2.5) 


Then for all a such that 0 < a < a*(m,n), the estimator 6 is 

unbiased and improves upon vhen the loss function is squared 
error. 


If a (m, n) > 1 for both pairs (m, n) and (n,m) then 
symmetry implies that 5 . is better than both ? and y . 

-L X y 

if 

The constant a (m, n) is obtained as a lower bound for 

M s= Inf R(p) •Vibere R(p) is given by 
0 <p<l 

2E W T^ 

R(p) m • — K K ; — -3^ , (6. 2,6) 

EW (pTy + {l-p)Tp 

and 

“ 1 - p + pv * •, 

Bhattacharyya (1981)' obtained a sharper lower bound A(m, n) 
for M and proved the 

Theorem 6 , 

Et^2 
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where 




Aj^{m,n) « E(t^ v“^)/E(T^ v"^) 

■iXi 

A2(m,n) =* E k{V)/E t\2(v) . 


(6. 2.8) 


y- ' " • (6. 2. 9) 

Then for an a such that 0 < a < A(m,n), the estimator 6 domln- 


ates f . 

#\ii 


— ? • As earlier, & vd.ll be better than both Y and v 

X Y* 

if A(it, n) _> 1 for both the pairs (m, n) and (n,ni) . 


Remark 6. 2. 3 : The difference between Cohen (1976) and Bhatta- 

charyya (1981) approaches is that Cohen finds lower and upper 
bounds for the integrands whereas Bhattacharyya finds these bounds 
for the integral itself. If ayandom vector (z^, ..,,Zj^) has i 

<®1 ®X> < ®min ^ ®max' 

This fact explains vAiy Bhattacharyya* s bound is larger than Cohen's 

I 

bound. 1 


6,3 Improving upon the Bounds of Cohen and Bhattacharwa 


The estimator 6^ will be better than f iff 

gL 


0 < a _< M = Inf R(p) . 
0^<1 

.2 


(6. 3. 1) 


2E W T 


Consider 


R(p) = — j 


( ( 1-p) + P ) 


(6.3.2) 


Clearly 

vdiere 

and 


R(p) > 2 min(M,.ip),M2(p) ) » 


(6.3.3) 
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In Bhattacharyya's bound A(m,n), the terms mlnCl, (m, n) ) 
and AjCm.n) were obtained as lower bounds for M^(p) and M^Cp) 
respectively. However, Aj<m,n) as a bound for M^tp) can L 
improved, we give below two other lower bounds for M 2 (p), one 
Of viiich is better than the other one though not always 

better is much simpler to calculate. 

Rewrite M^Cp) as EWg^^ (U) /EW^g^ / where g^^Cu) = E (T^ I U=:u) 

and g 2 (u) = E(Ty ] u=u) . If vfe denote by h^(u) the density of U, 
then 


M,(p) 


/ w gj^(u) h^(u) du 

■ ^ — 

/w g2(u) hj^(u)du 


= E ( 1-p+pU ) 


2, 

g^TuT 


> min(E 


g^^Cu) 

1 g^IuT' 


u^g^cu) 
'1 “gTTuF 


) 


where denotes the expectation vdth respect to the density 
2 

w g 2 (u) hj^(u) 

h^(u,p) = - 2 — — . The fact that the density h. (u,p) 

/ w g 2 (u) h^(u)du 1 


has a monotone likelihood ratio (MLR) in (p,-u), that is, for 

> P2, < U 2 ; 


h^(Ujl^»Pl) hj^(u.2<P2) “ ~ ® * 


then proves the follovdng theorem (see Lehmann (1959, p. 74) for 
the related property of the densities having MLR) . 


Theorem 6. 3. 1: 


(i) Let E(T^ V~h and E^y v“ be finite and 

(u) 


gi' 

let f be symmetric about 0. Also let be an increasing func- 

tion of u and 


B (m, n) ss 2 min (1, Aj^ (ro, n) , A^ (m, n) ) , (6*3. 4) 
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where A^(m,n) is as in (6.2.8) and 


. / ^ E(t^ v"^) 

A3(m,n) = min(— 5— ^ ^ 

E(T V 2) E(T^ V"2) 


(6. 3, 5) 


Then for all a such that 0 < a < B (m,n), the estimator 6 doml- 


nates Y . 

X 


(11) Let E(T^ V 2), E(Tp and E(t| V-2) be all finite and let f 
be synunetrlc about 0. Also let be a decreasing function of 


u and let ' be an increasing function of u and 


vAiere 


B 2 (m,n) = 2 min( 1, A^(m, n) , (m, n) ) , 


(6. 3.6) 


Eirb e(tJ v"-^) 

A 4 (m,n) = min(— 


E(Tp E(Ty V""^) 


). . 


(6. 3.7) 


Then for all a such that 0 < a < B (in,n), the estimator 6 domi- 

*• ' a 


nates ^ . 


(iii) Let E(Ty) and E(T^ V ^) be finite and let f be syiranetric 


2 


about. 0. Also let u a decreasing function of u and 

BjCmsn) = 2 min(l,Aj^(m, n),A 5 (in, n)) , (6.3.8) 


where 


X 

A- (m, n) =r min( — — *■ 

^ tr* / 


E (T^) E (T^V) 

17“^' 


E(Ty) E(Tp 


(6. 3. 9) 


Then for all a such that 0 < a < B.,(m, n), the estimator 6 is 

■'9L 

better than 


Remark 6. 3. l : In the expression for A 3 (m, n) the second component 

is always larger than A 2 (m, n) but the first component is sometimes 
smaller than A 2 (ra,n). Thus Bj^(in,n) is not always better than 
Bhattacharyya' s bound A(m. n) . 
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6. 3, 2: A^(m,n) is ad ways larger than A 2 (rn,n) 

B 2 (m, n) improves A (m,n). 


and so 


Remark 6,3,3:' In A^{m, n) the first component is larger than 
A 2 (m^ n) but the second is not always so with the consequence that 
B^Cm, n) is not always better than A(m, n) . 


Remark 6.3.4: The constants B^(m,n), i = 1,2,3 are relatively 

simpler to compute than A(m, n). 


5 • Using the MLR argument as applied in the proof of 
the above theorem, one can get an alternative proof of Bhatta- 
charyya's claim M^(p) > 2 min( 1, Aj^(m, n) ) . 

To obtain another lower bound on M 2 (p) , we now consider 

2 

/ w g 2 (u) hj^(u) du 




/ w g^(u) hj^(u) du 


w g2(u) 

= ^2 g^(U) 


g2(u) 


^ ^2 gTTiJr ^ ' 


where E 2 is the ej<pectation with respect to the density 

w g ^ { u) h ( u) 


h2(u,p) = 


/ w gj^(u) h^(u) du 


Once again using the fact that the density h 2 ^u.«p) has MLR in 
(p, -u) the following result can be proved. 

Theorem 6. 3. 2 : (i) Let E (T^ v"^) and E(Ty h (V) V~^) be finite 

g2(^) 2 

ard let f be symmetric about 0. Also let ■^yTuT ^ ^ decre- 
asing function of u and : / 
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B^{m,n) = 2 min(i,A^(m,n),Ag(m,n)) , (6.3.10) 

where 

Ag(m,n) = ECt^ v~^)/E(t 2 h(V) v"^) . (6.3.11) 

Then for all a such that 0 < a < B (m, n), the estimator 6 is 

3 . 

better than Y . 

X 

(ii) Let E(t 2 V~2) and E(T^{v)) be finite and let f be symmetric 
^ 92 o 

a out 0, Also let h(u ) be an increasing function of u and 

B„ (m, n) * 2 min( 1, Aj^(m, n) , (m, n) ) , (6.3.12) 

and 

A7(m,n) = E(t2)/e(t 2 h(V)) . (6.3.13) 

Then for all a such that 0 < ^ ^ , the estimator 6 is 

better than Y . 

Ren^ark _ 6. 3. 6 ; The constants B^(m, n) and B^ (m, n) are never smaller 
than A(m,n) and so in both the cases Bhattacharyya' s bound is 
improved. As vd.ll be seen in Section 6.5, for the uniform distri- 
bution, there is substantial improvement over A(m, n). 

Remark 6.3.7 : The conditions for simultaneous iinpTOv^nent over 

both the estimators and 'ify are similar to the one in Reanark 
6.2.1 following Theorem 6.2.1. Thus, the estimator 6^^ improves 
both and if the bounds obtained in Theorems 6.3.1 and 6. 3. 2 

are not less than 1 for both the pairs (ro, n) ar^l (n,m). 

6,4 A Class of Estimators Improving upon the Estimators from 
Both the Samples 

Shinozaki (1978) considered estimators of the form 
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viiere 


c r 


w, = 


-2 

X 


-2 -2 

c + y 

X y 


and 


W 2 = 1-W^ . 


When the populations under consideration are normal, he obtained 

conditions on c such that 6* improves both and 'f , Similar 

c X y 

results were obtained later by Bhattacharyya (1984) and Kubokawa 
(1987c^ but only for the case of normal populations. We consider 
this problem in the location- scale set up, introduced in Section 6.2. 

Using the results of Hogg (1960b) it is easily seen 
that 6* is unbiased and the condition Var(6*) < var(¥ ) for all 

c C ““ X 

2 2 

(6/Ox/Oy) is equivalent to M(c) > 1 where M(c) = Inf R(p, c). 


R(p,c) = 


* 2 
2EW T 

X 


0,<p<l 


EW*^((l-p)T^ + pTp 


^ and W a 1/ ( 1-p+pcV) . As M(c) is. 


in general, difficult to calculate, we find some lower bounds for 
M(c). The methods used are similar to the ones in Section 6. 3, 
Now 

■|r(p,c) > m'in(Mj^(p, c) ,M 2 (p, c) ) , 


(6. 4. 2) 


where 

and 


M 


3 _(p,c) = E(W*T^)/E(W*^^) , 
(p, c) = E (W*tJ) /E (W* hh . 


(6.4.3) 
(6. 4.' 4) 


If we write g* (v) for E (T | v=v) , Mj^(p, c) is 


_ Ew* q* (V) 
EW* \* (V) 


/ g* (v) h” (v) dv 
/ w*^ g* (v) h* (v) dv 


,* 1 


W 




> roin(l#cE (V)) 
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u*ere in the above expressions, h* (v) denotes the probability 
density of V and E* is the es^ectation with respect to the density 

h*(v,p) - - 

■' w g (v) h (v) dv 

Since h*(v,p) has MLR in (p,-v) we have Mj^(p,c) 2 
minCl, cA^(m, n) ) , vohere is as defined in (6.2.8), Also, 

we have k(cv) < W* < h(cV) so that 

1^2 (p,c) > A 2 (c,m, n) , 

where A 2 (c,m,n) = E{tJ k{cV)} / e{T^^(cV)} . (6.4.5) 

We have thus the follovdng result* 

6. 4. 1 ; Let E (T^V ^) be finite and let f be synmetrio 
about 0. Then the estimator 5* is better than for all c such 
that ET^^(cV) < oo and 

2 min(cA^(m, n),A 2 (c,m, n)) > 1 . (6.4.6) 

Remark 6. 4. 1; By symmet3ry, we can show that 6* is better than 
Yy/ if E(TyV ) is finite and c is such that ET^^( 1/cV) < » ^nd 


2 min(~ A^(n,m), A 2 ('^,n,m)) > 1 . (6. 4. '7) 

Remark 6. 4. 2 : Combining (6.4.6) and (6. 4 . 7 ) we get the class of 

estimators 6* dominating both and Y . 
c 

Next, we obtain some other lower bounds for M 2 (p/c). 
the notation of Section 6. 3, we can write 


M 2 (p, c) 


e/ g^(U) 
EW*^ 92(11) 
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/ w h^(u) du 

— 

/ w h^(u) du 

8l(U) 

^ w* g2(u) 


* 






where is the expectation with respect to the density 

w* ^ *32 h. (u) 

h.(u,p) = To , which has MLR in (p,-u). 

/ w 92^^) hj^Cu) du 


Define 

e(tJv~^) 

P.(m, n) = s — y- 

^ EiTpr^) 


P 2 (m, n) 


P^Cm, n) 


E(T^) 


E(Tp 


and P.(n\, n) 


E(T^v"h 

E (TyV"^) 
E (T^V) 


E(Tp 


Then we have the following theorem. 


(6. 4.8) 


Theorem 6.4.2 : Let f be symmetric about 0 and either of the 

conditions - (i) , (ii) and (iii) stated below hold. 

, 9 -9 , . 


(i) E(T^v"^) and E(tJv h are finite, 

UC j 


is increasing in u 


2 min(cA^(m,n) ,Pj^(m,n),cP 2 (n».n)) > 1 . (6. 4.9) 

(ii) E(T^v'^), E(tJ) and e(t‘v"^) arc finite, is decreasing 

q 1 ('n) 

in u, ^ (h r- is increasing in u and 


2 minCcA (m, n) ,P 2 ^ ^ ^ * 


(6. 4. 10) 


(iii) E(tV^) and E(T^) are finite. 


2 

u gj^(u) 


[>-V ) ana i^v-LyV ate 


is decreasing in 


u and 
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2min(cA^(m,n),P2(m,n),cP^{m,n)) > 1 . (6.4.11) 

Then 5 improves 

C -?v 

Remark 6 . 4. 3 : By symmetry we again get the conditions for 6 * to 

c 

dominate Yy and combining these with (i). (ii) and (iii) , we get 
the class of estimators dominating both and fy. 

Remark 6.4.4 : Akai (1982. Cor. 2.3) has given a sufficient 

condition for 5 * to dominate He proved that if 

E(T^V"^)/E(tV^) < E(T^v“^)/E(T^v”b . (6.4.12) 

★ 

6 ^ improves for c > l/ 2 P 2 (m. n). 

It can be shown that Akai's condition is weaker than 
condition (i) of Theorem 6 . 4. 2. The proof uses the following 
integral inequality (see Bhattacharyya (1984) for details) 5 

Let Z 2 and be functions of a random variable T; 

Z 2 be positive with a finite expectation and Zj^/Z 2 and Z^ be mono- 
tonic in opposite directions. Then 

E(Z^Z2)/E(22Z2) < EZj^/EZ2 (6.4.13) 

Choosing T = U, Z^^ = u"\j^(U), Z 2 = H ^ see 

that condition (i) of Theorem 6.4,2 implies (6,4.12). 

However, Theorem 6,4.2 also applies to situations where 
the condition (6,4.12) is not satisfied. Note that if -{-y is 
decreasing u, then 

E (T^v’^)/E(tJv”^) > E^TxV"H/E (T^v"h 

and Akai's result is not applicable. 
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Once again consider 1^2 (p/ c) : 


M- {p, c) 


E w*^ 92 (U) 

E w* g^(u) 

/ w*^ g2('i) hj^(u) du 
I w* gj^(u) hj^(u) du 

* * 

^2 ^ iTTuy 


* ^2^^^ 2 


tC 

where E^ is the expectation with respect to the density 
w g, (u) h, (u) 
h 2 (u,p) = 5 ; 


; w gj^(u) hj^(u) du 
Define 


vhich has MLR in (p,-u). 


ET 


P5 (c,m, n) * j 


and 


E Ty h(cV) 
E(T^v“^) 

Pa ( c, m, n) «= 5 — rT“ • 

° E(Ty h(cV)V ) 


(6.4. 14) 


Then we have the following result. 

Theorem 6. 4. 3i Let f be symmetric about 0 and either of the 

conditions (i) and (ii) stated below be satisfied 

o 92^^^ 2 

(i) E(tJv“^) and ElT^hCcV)) are finite, ^^-jj^hCu ) is increasing 
in u and 

2 mintcAjL(m,n) ,P5(c,m,n) ) > 1 # (6.4.15) 

1 92^^^ 2 

(ii) E(tJv"^) and E(T^(cV)V ^) are finite, h(u ) is decre- 

asing iri"'.U;and' 


2 min( n) # Pg (c# nt# n) ) 1 ♦ 


(6e A. 16) 



Then 6 dominates f . 

C 3C 

Remark 6»4. 5 : Symmetry considerations once again give conditions 

for simultaneous improvement of and f„. However, the class of 

X y 

such estimators is difficiHt to obtain here. 

Remark 6. 4. 6 : Let condition (i) of Theorem 6. 4. 2 be applicable 

gTui) ^ 

that is/ g- ' ^^y be increasing in u. Then 6^ improves if 
2P^(m,n) > 1 and c > l/2min(Aj^ (m, n) , P 2 (m, n) ) . In this case 
condition (ii) of Theorem 6,4.3 also applies and we conclude that 
6* improves if c > l/2A^(m,n) and 2Pg(c,m,n) > 1. Notice 
that Pg(c, m,n) < cP 2 (m, n) and so whenever 2Pj^(m, n) > 1, the class 
of estimators dominating '? obtained by Theorem 6.4.2 contains 
that obtained by Theorem 6.4.3. However, if 2P^(m,n) < 1, Theorem 
6.4.2 fails to provide an estimator 6* improving 'f vJiereas 
Theorem 6. 4. 3 still gives such estimators. 

Remark 6.4.7 : we also have A 2 {c,m, n) < Pg(c, m, n) for eacb c, m 

and n. This means that the class of estimators 6^ dominating 
obtained by Theorem 6.4.1 is smaller than that obtained 
by Theorem 6.4.3 provided condition (ii) of Theorem 6.4,3 holds. 
Once again, it may happen that Theorem 6.4.3 is not applicable 
and we use Theorem 6,4. 1 to get 6* dominating . 

6.5 The Uniform Distribution 

In this section we apply the resxilts of Section 6.3 to 
the case vhen we have two popvdations having uniform densities 
which are symmetric about the cominon location parameter © and have 
unknown and unequal scale parameters 0 ^ and Oy. The bounds 
B^(m,n) and B^Cm.n) of Theorems 6.3.1 and 6.3. 2 are evaluated and 
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^ ■ 

the larger of the two is tabulated and compared with Bhattacharyya’ 

bound A(m, n) for specific values of m and n. 

1 1 

het f(x) = i, ~ S. ^ S "j’ Also let Y and of Section 
6.2 be + ^( 1 )) and respectively, vhere 

X^ , . . . , are the order statistics of the first sample, 

similarly define and for the second sample. The variables 
'^y' ^x' ^y' ^ same as in Section 6. 2. For 

convenience, take and Ly »> 2Ty. The joint probability 

density of and S^, as given by Cohen (1976), is 

,s ^^x'®x^ ~ 2 ^(m-l) 3^ , ^ ^ ^“®x' < a < 1 . 

X, "X! 

The conditional probability density of L given U = u is 

3C 

^ j{(j-l)(l+l^)J"2 - u(j- 2 )(l+l^)J "^3 

2 f j_u(j-2)} ' if ' 

^ j{(j-l)(l-l^)^"^ - u(j-2)(l-l^)J"^] 

1 jj::ulj-2)} - if 0<1^<1, 0<u<l ; 

. ju^"^ {(j-1) (1+lj^)^"^ - u(j-2) (1+1^) 

■5 {ju-(j-2)} “ ' “i^'^ix— u “ i' ' 

1 iju-ij-2 ) T ■ 1 < ixi 1 - ^ ' « > 1 ; 


^ ju^"^[(j-l) (1-1^)^’^ - u{j-2) (1-1^)^~^1 

1 { ju-(j-2y] 


if l-:s<l^<l. 


u>l. 


where j = ra+n. 

2 ■ '■ 

It can be seen that gj^(u) = E(Tj^ | U=u) is 

, {(j+2) - u(j-2)} ; ' ^ 

^ (j-.iHjt2) d-ud::^ ° ° ^ 

1 i , -. r i + h ^ 9 + i " u^ ^ 

7 t ju- (j-2) } L 1 j (j +lin (j+i) (j+2)u^ ^ 


= ${n ) , say, if u > 1- 
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Now by symmetry 


92(u) = E(t2 IU.u) . EtT^I ^ . 1) . g^(i, 


Thus, 


go(u) = 


a(-) , it u > 1 and 


0 (— ) , i L' 0 < u < 1 


and so 


g^Cu) 


0(l/u) 




, if 0 < u < 1 


, if u > 1 , 


It can be shown that the numerator in the expression of 

d CL ( ^ 

du ^0(l/u) ^ positive for all u £ and so is incre- 
asing for u8 (0,1]. This implies that too, is increasing 


for ue [l,~). Thus 


gj^(u) 


is an increasing function of u. 


Theorems 6.3.1 and 6.3.2 then give us bounds Bj^(m,n) and B^(m,n) 
respectively so that, for 0 < a < 8(m,n) - max( Bj^(m, n> ,B^(m, n) ) , 
the estimator 6, dominates . 

The bounds Bj^{m, n) and B^(m, n) can be evaluated from the 
expressions given below: 


A^(m, n) = 
A^Cm, n) = 
Ag (m, n) = 


(n-4) (n-5) (rtn-5) (m-f6) 

(n-2) (n-3) (m+1) (m+2) ' 

. . (n-2) (n-3) (n-4) (n-5) , 

^ (m+5T'(mW ' Tm^iS^aT ^ 

(n-4) (n-5) U^2) (144) HI-1) (1-2).^ 

[ (m+2) (m+1) (j+2) (j+l) j (j-1) (j-2) 

+ 2(m+4) (ra+2) (n-2) (n-3) (n-4) (n-5) (j+2) 

- 2(ra+3) (m+1) (n-2) (n-3) (n-4) (n-5) (j-2)] 
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It is observed that in the evaluation of the bounds 
B^(m, n), B^(m, n) and Bhattacharyya’ a bounfl A(m, n), n) does 

not play any important role. In fact, it is seen that whenever 
A^(m, n) is less than 1, the bound ia smaller than 2Aj^(m, n) . Thus 
improving A 2 (m, n) of Bhattacharyya' s bound gives a better bound. 

The values of B(m,n) are presented in Table 6.1 for m = 2(1)15(5)50 
and n = 6(1)15(5)50. A starred entry corresponds to the case vhen 
maximxm is B^(m, n). A blank entry stands for the value being 2. 

We observe that improvement over both an! is possible for 
n > 20 if m = n and for all n_> 32 if m^ n+5. Bhattacharyya 
through A(m,n) was able to show this dominance for n _> 25 if m = n 
and for all n > 35 if m < n+5. 


gi(u) 

Since g~^y is increasing in u we can apply Theorems 6.4.2 
and 6.4.3 also. However, as mentioned in Remark 6.4.4, Akai's 


(1982) result would give a larger set of c's for 5^ to improve 
and 'fy. 


6.6 A Differential Inequality for Improving the Graybill~Deal 
Estimator of the Common Mean of Twd Independent Nojgnal 
Popxilations 


Let X = (X^,...,X^) and Y « (Yj^,.,,,Y^) be independent 

random samples from two normal populations with common mean p and 

2 2 

unknown and possibly unequal variances and respectively. 

The problem is to estimate p with either of the two loss functions; 

L^(p,p) = (p-p)^ (6.6.1) 

and L 2 (P/M) = (p-p)^/oJ (6.6.2) 

If o?/o^ is known, the estimator T = oX + (l-a)Y, where 
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it>y 


_ _ 

a _ — is the best linear combination of X and Y. Since 

c^/m XI 

T is a function of the complete sufficient statistic, it is also 

uniformly minimxim variance unbiased estimator (UMVUE) of js, 

2 2 

The problem changes completely, in case o 2/^1 i s unJcriov®* 
In this case, the minimal sufficient statistic (X, Y, S 2 ) , 

where S^, S 2 are the sample sums of squares, is not complete as 
E(X-Y) = 0. It can be shown that a UMVUE of ji does not exist. In 
fact, it has been established by Unni (1978) that the nonexistence 
of a UMVUE holds for any unbiased estimable function of p. 

One of the most corranonly used estimators of m is the 
Graybill-Deal (1959) estimator given by 


S^X + S^Y 


(6.6.3) 


It was shown that Mqq dominates both X and Y if and only if ra 
and n are at least 11. A detailed account of the results related 


to the properties of the Graybill-Deal estimator and its compa- 
rison with some other estimators is given in Section 1.1. 2, 


However, so far there is no definite resudt proving or disproving 
the admissibility of in the class of all the estimators. 

Sinha and Mouqadem (1982) considered subclasses and 

C 2 of unbiased estimators, viiere 

= {M: m = X + (Y-X)'? , 0 < f (3_^,S2, (Y-X) ^) < ll , 


= ip: p X + (Y-X)? , 

= { p : M = X + (Y-X.) 'i , 

= {p: M = X + (Y-X)f , 


0 < Y(S2/6j^) < 

0 < Y(3^,32) < 

0 < f ( ' ' 

“ (Y-X)"^ 


li , 
ll , 


(6.6. 4) 



) < 1 1 . 
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It was shown that is admissible in and extended admissible 


in ^ . Also it was shown that Mpn cannot be Bayes or limiting 


Bayes in provided the prior distributions satisfy a mild 


condition. However, it does not prove inadmissibility of pt 


In this section, we obtain a differential inequality, a 


solution to vjhich will provide an iraprovoment over in the 


class For convenience we take m « ri. 


.et 5 ,y = X + (Y-X)f (Sj^, S 2 ) be an estimator in Writii 


2 2 

e for ip, have 


R(e, 6 ^) « E<X + {Y-X>f(S^,S 2 ) - M). 


+ 2E (X-m) j,, S 2 ) 


Since (X, Y) and ( 3 ^, 32 ) are independently distributed, we have 


[^1 + 'i^iSyS^- - 20^ E 1'(S^,S2)1 . 


(6.6.5) 


The estimator as defined in (6. 6. 3) belongs to with 

S ^ 2 

( 3 ^, 32 ) = s " ■f 'l" m » n. Denoting by T the variable g^+g-- . 

12 


consider 


R(©/6,p) < R<©/%n) for all e 


( 6 . 6 . 6 ) 


{oj + a^)E(^^(S^,S2)-T^) + 20^ E(T-'?(Sj^,S2)) < 0 


for all ^^2^ * 


(6.6.7) 


Dividing both the sides by ojo^, the inequality (6.6.7) reduces t( 


2 „ 2 , 


1_ + i_)E('j?2(S.,S„)-Tn + E(T-'F(S^,S 2 )) < 0 for all {Oy 


+ -~)E('J?-^Sj^,S2)-T / + — 

ol 02 ""2 


( 6 . 6 . 8 ) 
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Stein ( 197 3) gave an identity vhich gives an unbiased 
estimator of the risk difference of two estimators in case the 
underlying distribution is normal. Hudson (1978), using the 
same technique of int.egrating by parts gave the follovdng iden- 
tity for the ejqjonential family: • 


L emma 6.6. 1 : Let X be a continuous ra»3om variable vdth the 

density 

fgCx) » 


with support (c,d), (c and d coxild be -oo and +» respectively). 
Let 


Lim e®^ (x) » Lip e®^{x) = 0 
x-»c x*d 


#SiS 


and 


t ( x) - - 


k‘ (x) 


k(x) * 

Then for any absolutely continuous function g on R such 
that E ig' (X)i 


Ei(t(X)-e) g(X)} =E{g*(X)} 


(6.6.9) 


Si S 2 

Since — 2 and —x are independently distributed 
01 02 

random variables, the above identity can be applied. Let h(si, S 2 ) 
be absolutely continuous in both it s arguments and s|g Si^ ^^1'' ^2^ i ' 
and E | gs ^ ^ 1' ^2^ | finite. Then 

E!h(3j^,S2)) = E[-i^ h(S^,S2) + 2 -jI- hCSj^.Sj)] , i = 1, 2 . 

°1 ^ ( 6 . 6 . 10 ) 

We now obtain an unbiased estimator of the expression on the left 
hand side of the inequality {6.6.8) by an application of (6.6.10) 
The unbiased estimator turns out to be 





16 2 


= 4'r 


IL 

as 


(S.+S-) , 

+ 4('F-l) + {n-3) 

3’^ >o ^ 2 


_ -2 (n-3) ^ (n- 3)32 


8 S 2 S 2 


S^is^+S^) 7s2+S^)3 


( 6 . 6 . 11 ) 


If we can find a such that Q ^ ( 3 ^. 82 ) < 0 for all 
Si/ ^2 > 0 and ^2 , 2 ^ ^ ^ ° some ^' 2 ^* 

the inequality ( 6 , 6 , 8 ) will be satisfied for all (o^, with 

strict inequality for (<?! # Thus 5 will be an inrorovement 

A f ! 

over Mgd* We can state the above result in the following theorem.: 

■' '■ , ' " ' I 

6 . 6 . 2: The estimator can be improved by an estimatorj 

6 ^ in with respect to loss functions ( 6 . 6 . 1 ) and ( 6 , 6 , 2 ), j 

provided 'V satisfies 


4^ 


|1- * 4(>f-l) II- , (n-3) .2 _ 2 in- 3) 

° ®1 “^^2 * 1*2 *" 




(n-3) Sj^ 

;2 ( S1+S2) 


^*1*2 

(31+32) 


3 


< 0 


(6.6. 12) 


for all S 2 ^ ^ with strict inequality on a set of positive 


2 2 

probability for some (^j^, *^ 2 ^ 


i#i 


Remark 6,6,1 ; We do not yet have a solution for the inequality 
(6.6.12). However, in view of the result by Sinha and Mouqadem 
(1982) that is admissible in we should search for a Y 

whicdi does not depend on S^, S 2 only through S 2 / Sj^. 

6.7 Estimating the Cotrenon Mean of a Bivariate Normal Population 
VJhen the Correlation is Nonzero 


Let (X^, Y^) , (X 2 , Y 2 ) , . . . , (Xj^, Y^) be a random sample from a 
bivariate normal population with the common mean p, unknown and 
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2 2 

unequal variances a and unknown covariance d, ^ « pc, 

_ _ 2 n 

Let (X, Y) be the sample mean vector, 3. « — ^ E 

^2 ~ n- 1 . and 3j^2 “ we estiinati 

M with the loss function 


L3(M,a) 


4n /A ,2 
—5 (p-a) , 


(6.7. 1) 


The J1LE of p is given by 


A — — — (S.-S , o) 

p, * Y + (X-Y) 

<Sj-fs|-2Sj2) 


(6.7. 2) 


(seeHalperin (1961)). 


Kri shnamoort-hy and Rohatgi (1988a) consider 

Vi = ^j^-Yi and « X^ +Y^ , i « 1 , . . . , n 


,2 2 


i . i i 


(6.7.3) 


and take U, V, Sy, S^, Sy^ as the sample means, variances and 


covariances based on (^i.Vi). We have ^ ' 

, ■ . Vi 

E(Ui) = 0, E(Vi) =0, Oy « Var(Ui) - oj * ^2 ~ ^°12 

= Var(Vi) = + 0^ + 20^3, - Cov(Ui,Vi) = ' 


In terms of the transformed variables,P 2 can be written as 




lev - u-^) . 


:i. . 

(6.7.4) 

" 'v :• i: 


Krishnamoorthy and Rohatgi proposed an estimator P 3 ,v 4 iidi is 

2 ' ' ^ ^ 2 

obtained from P 2 by replacing Sy by E Ui/(n-l). Thus 

1=1 


^ l,zz - UV ^ 

P 3 = j(V - U — -) , 

E Uf 
i=l 


(6.7.5) 
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v^iere = (n-Ds^^ 

It was shown that 
R(G,I1^) < R(Q,fl^) 


e = IP, oj, a^) 


if and only if 

r 2 ^ ( 2 n- 1 ) (n-»- 4 ) 

(7n^-8n-4) 

where R is the correlation coefficient between U and V. 


(6.7.6) 


Some Modifications of U j 

^ 3 

The multiple of ^ in ^2 ia whidi is unbiased for 

3*1 


” ,2 ^ 


uv 

p • 


However, its modification E in has an expectation 

i w 1 

2 

(n-l) Oy^/n Oy. Therefore it seens reasonable to have a multiple 
* 

S ^ ’■ " 

— - and consider the estimator 

11 “* X n 


s u. 
i = l 


" _ i(v _ -JL. 1 ) 


n-l n 


(6.7.7) 


E U‘ 
i«l ^ 


The risk ejqsression for M 3 ('j^r^) can be obtained from the computa- 
tions in Krishnamoorthy and Rohatgi ( 1988a) i 

R(e-A3‘Kri) > = c <n2.2„-2) (n.4) - n(n^4«n-4)R2 ] . 

(6.7.8) 

We can easily prove the following result. 


Theorem 6.7. 1 : The estimator ^ 3 ( 7 ^^ risk smaller than that 


of ^2 only if 


„2 . (2n-l) (n^-4) 

(7n^-12n+8) 


(6.7.9) 
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Remark 6.7, 1; Comparing (6.7.6) and (6. 7. 9) , we observe that 
for n > 3,. M 3 ( 2 ^ has a larger region of dominance over ^2 than % 
Next/ we consider estimators A 3 (c) proposed by Krishna- 
moorthy and Rohatgi { 1980a) , 


M3(c) 



c U S 


n 

E U 
i =1 



c real . 


(6.7. 10) 


As in the case of M 3 (-^p^), the risk expression for ^ 3 ( 0 ) can be 
obtained from the computations of Kri shnamoorthy and Rohatgi: 


R(e,M3(c )) 


(l+k+2p\nc) [ 1 


4. c^(n- l) 

n(n+ 2 ) 


R^(n-l) 

(n+ 2 ) 




(6.7. 11) 


Now 


R(e,P3(c)) < R(e,P2) 
if and oiHy if 

R^ < B(c) , 


where 
B (c) = 


(n+4) r n(n+2) - c^(n- 1) (n-3) 1 

[(n-3)(n-l) ( c^(n-2) (n+2) - 2n(n+4) c 1 + n(n+2) (n+4) (n-2)l 


(6.7. 12) 


We can get a c such that M 3 (c ) has the largest region of 
dominance over ^3 among all ^ 3 ( 0 ) by maximizing B(c) with respect 
to c. The c can be easily seen to equal' 


3 2 1/2 

(n+2) r (n-2) (n+3) f6(n + n - 6n + 12) i ^ 1 
TSriTt („-3l(W4> - ‘ („.2)(„.3)2(n.4) = 

In Table 6.2 we have presented values of c . B(l), 
and B(c*) for n = 5(5)50. The value of c* is seen to be larger 
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TAjPLg 2 

Region of dominance of M 3 (^) and ^ 3 ( 1 ) over 


n 


★ 

c 

B(c*) 

B(-^) 

n-1 

B(l) 

5 


1. 299194 

0.659976 

0.658537 

0.618321 

10 


1. 1029 29 

0. 452566 

0. 452381 

0. 431818 

15 


1. 058468 

0. 3937 25 

0.392730 

0.379738 

20 


1. 039963 

0. 366 106 

0. 364486 

0.355083 

25 


1. 030068 

0. 350086 

0. 348028 

0.340635 

30 


1.023984 

0. 339629 

0. 337 256 

0.331242 

35 


1. 019893 

0. 3 3 2267 

0. 329658 

0. 324569 

40 


K 016966 

0. 326803 

0.324012 

0. 319603 

45 


1. 01477 4 

0. 322587 

0. 319651 

' 0.315753 

50 


1. 013075 

0. 319235 

0.316182 

0. 312705 

than 

1 and 

it tends to 1 

as n increases 

to infinity. 

The dif fer- 

ence 

B(c*)- 

-B(l) is large 

compared to B( 

c* ) - B (— ^) for 
n - 1 

small values 


of n, and as expected, decreases to zero as n approaches infinity. 


Minimal Complete Class of Estimators MjCc) 

It is clear that R(0,p3(c)) of (6.7.11) is a convex func- 
tion of c. For fixed 0, the c minimizing R{©,|i 3 {c)) is 

J(e) . nislllR! (6.7.13) 

(n+4) + (n-2) (nt2)R 

vvhich clearly depends on 0, However, . . ' • 

, , , .,f’. ... ^ . '.I... ..., . .1 

Inf c(0) = 0 and Sup c(0) « . 

© . “ S ' 

An application of the Br ewsteT^Zid^ t^Anique ( 197 4) leads to %e 
conclusion that the estimator ti 3 C#' 4^;}# is^i^roved by 
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^3^n+l^ ^ 3 ( 0 ) for c < 0 is improved by^^^O) = Also 

the estimators ^ 3 ( 0 ), 0 < c < ||| are admissible among all M 3 (c) 's. 
This proves the follovdng result, * 


^ • The class {^ 3 ( 0 ): 0 ^ c ^ is minimal essen- 

tially complete among the estimators of the forraMo(c). 

*3 

Remark 6,7, 2 » Kri shnarooorthy and Rohatgi also suggested esti- 
mators 


A 


(c) = 


|(V - 


C U 



(6.7. 14) 


The c minimizing RCe.p^Cc)) for fixed 0 is 

ae) . , 

(n-4)R + 1 

which attains its minimum and maximum at R «= 0 and 1 respectively. 

Thus lnf'c(0) = 0 and Sup c(©) = 1. Since R(0 .m, ( c)) is a convex 
0 © 

function of c. we conclude once again by the Brewster- Zidek tech- 
nique that the class {n 2 (c) : 0 _< c _< IJ is minimal essentially 

/S 

complete among the estimators of the form JJ. 2 CC). 


Risk Comparisons 

We have compared numerically the risk performances of 
estimators ^ 2 / A 3 / A 3 ^ 3 ( 0 *). We have tabulated these 

risks for n = 10, 20, 40 and various values of P and k (Tables 
6,3 to 6 . 14). Although none of the estimators is seen to dominate 
any other estimator uniformly, some general trends can be noticed. 
For fixed P, the estimator ^2 performs best in the region 
0 < k < 0. 4 . Similarly M 3 performs best in 0.6 < k < 1 . 
However, for 0 < k k 0. 4, the estimator M 3 is the worst and 
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Values of Aj = Rle.Mj), Aj . R(9,R3), A3 . R(9,;i3(^)) 

A4 a Ri&, } ) 

n tr 10 


TABLE 6.3: P » 0. 2 


k 


^2 

^3 


0. 001 

0. 004440 

0. 094334 

0. 065686 

0.067 294 

0. 005 

0. 022466 

0. 111534 

0. 083154 

0.084746 

0. 010 

0. 045243 

0. 1327 7 2 

1. 104733 

0. 105294 

0. 040 

0. 182857 

0. 257714 

0. 233228 

0. 234544 

0. 100 

0. 4507 99 

0. 498323 

0. 481599 

0.482393 

0. 200 

0.859565 

0.864490 

0.859897 

0.859876 

0. 400 

1. 530428 

1. 467582 

1. 482215 

1. 480897 

0.600 

2. 040941 

1.930833 

1.9587 23 

1.955495 

0.800 

2. 434327 

2. 292255 

2. 328949 

2. 325100 

1. 000 

2.7 42857 

2.680000 

2.622222 

2.618962 




TABLE 6.4: p = 

0. 4 


k 

Ai 

A2 

/^3 

A4 

0. 001 

0, 003936 

0.095028 

0.066000 

0.067629 

0.005 

0. 020244 

0. 112243 

0. 082869 

0.084512 

0.010 

0. 041290 

0. 132934 

0. 103599 

0. 105234 

0.040 

0. 17 4545 

0. 257688 

0. 230592 

0. 232058 

0. 100 

0. 453355 

0.511821 

0. 491603 

0.492592 

0. 200 

0.911866 

0.925571 

0.917997 

0.918127 

0. 400 

1.718052 

1.65i996 

1.666991 

1.665592 

0.600 

2.350 247 

2*225273 

2. 256810 

2. 254277 

0.800 

2. 832751 

2.6678i50 

2.710407 

2.707 098 

1. 000 

3. 200000 

3*010000 

' 3.059259 

3,055455 
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. _ ■ ' ; , ... 

TABLE 5: p = 0.6 


k 

y^i 

"^2 

^3 

^4 

0. 001 

0. 003038 

0. 095883 

0. 065959 

0.067611 

0. 005 

0. 015898 

0.111020 

0. 080666 

0.082367 

0. 010 

0. 03 287 3 

0. 129 245 

0. 098434 

0. 100154 

0. 040 

0. 145 286 

0. 240457 

0. 209947 

0. 211614 

0. 100 

0. 40605 2 

0. 482316 

0.456596 

0. 457909 

0. 200 

0. 88 2111 

0.915879 

0.902020 

0.902513 

0. 400 

1. 825567 

1.767314 

1.779446 

1.778173 

0. 600 

2. 618151 

2. 484005 

2. 157521 

2.51479 0 

0.800 

3. 220878 

• 3.034553 

3.082568 

3.078827 

1. 000 

3. 657143 

3. 440000 

3. 496296 

3.491949 




TABLE 6.6: p 

w 0* 9 


k 

^1 

^2 

^3 


0.001 

0. 000920 

0.095251 

0.065201 

0,066889 

0. 005 

0. 004948 

0. 105364 

0.07 3632 

0.075159 

0. 010 

0. 010465 

0. 115276 

0.081855 

0.083729 

0. 040 

0. 05109 2 

0. 169067 

0.131310 

0. 133415 

0. 100 

0. 16 3637 

0. 290174 

0.249 294 

0. 251538 

0. 200 

0. 439766 

0.558314 

0.519007 

0.521073 

0. 400 

1. 328192 

1. 37 2210 

1.353517 

1. 354137 

0.600 

2. 533189 

2.452222 

2.469098 

2. 467329 

0.800 

3. 656545 

3. 458232 

3.508532 

3.504522 

1. 000 

4.342857 

4.085000 

4. 151852 

4. 146689 





n » 20 


TABLE 6,7: p » 0. 2 


k 

Ai 

^2 

A3 

^4 

0. 001 

0. 004114 

0. 0327 40 

0. 023397 

0.025259 

0. 005 

0. 020814 

0. 049303 

0. 039998 

0.041849 

0. 010 

0. 041916 

0.07 0002 

0.060820 

0,06 2643 

0. 040 

0. 169412 

0. 194182 

0. 186029 

0. 187520 

0. 100 

0. 417652 

0.435120 

0. 429247 

0. 430334 

0. 200 

0.796362 

0.802403 

0.800101 

0.800399 

0. 400 

1. 417897 

1. 405867 

1. 409205 

1. 408252 

0. 600 

1.890872 

1.866451 

1.87 3643 

1.871828 

0. 800 

2. 255332 

2. 222803 

2. 23248 2 

2.230095 

1. 000 

2. 541176 

2. 503636 

2.514833 

2.512085 




TABLE 6.8: p 

- 0. 4 


k 

^1 

^2 

^3 

^4 

0. 001 

0. 003645 

0. 032651 

0.023185 

0.02507 2 

0. 005 

0. 018755 

0. 048133 

0.038539 

0.040449 

0.010 

0. 038254 

0.067629 

0.058027 

0. 059934 

0. 040 

0. 161711 

0. 18907 4 

0. 180078 

0.181840 

0. 100 

0. 420020 

0. 440983 

0. 433968 

0.435282 

0. 200 

0.844817 

0.853924 

0.850602 

0.851094 

0. 400 

1.5917 25 

1. 579650 

1.582930 

1.581954 

0,600 

2. 177 434 

2, 149904 

2. 157985 

2. 155933 

0.800 

2.624460 

2.5857 38 

2. 597959 

2, 595190 

1.000 

2.964706 

2.920909 

2.933971 

2.930766 



IJ I 


TABLE 6.91 p - 0\ 6 




0. 024531 
0.037142 
0. 053220 
0. 158155 
0. 395 48 2 
0.828143 
1.683758 
2. 402880 
2.951043 
3.349447 


0. 0226 19 
0. 035169 
0. 051217 
0. 156172 
■ 0.393811 
0.827243 
1.684548 

2. 405061 
2.954167 

3. 353110 


0.032213 
0.045078 
0. 06 1291 
0. 166 2S5 


i*6'e'2802 


2. 941530 
3.333182 


table 6.10S p 


0 . 001 
0. 005 
0. 010 
0. 040 
0. 100 
0. 200 
0. 400 
0. 600 
0.800 
1 . 000 


0. 000852 

0. 004584 
0. 009695 
0. 047 336 
0. 151605 

0. 407430 

1. 230531 

2. 3469 25 

3. 387681 
4.023529 


0. 03087 1 
0.03656 0 
0.043099 
0. 085 139 
0. 192719 
0. 447 439 
1.251451 

2. 334349 

3. 3436 16 
3.96 409 1 


0. 021075 
0 . 026124 
0. 032195 
0. 07 2784 
0. 179240 

0. 434215 

1. 244114 
2.337480 
3. 356590 

3.981818 


0.023029 
0. 028204 
0. 034367 
0.07 5 238 
0. 18 1897 

0. 435770 

1. 245328 

2. 336380 
3.353317 
3.977 468 



n ^40 


17 2 


TABLE 6.11; p » 0.2 


k 

^1 

^2' 

^3 

>4 

0. 001 

0. 003990 

0.01217 2 

0. 009472 

0. 010257 

0. 005 

0. 020189 

0. 023342 

0.025651 

0.026 432 

0. 010 

0. 040658 

0.048708 

0. 046050 

0. 046820 

0. 040 

0. 16 4324 

0. 171507 

0. 169129 

0. 169810 

0. 100 

0.405110 

0. 410360 

0. 408607 

0. 409093 

0. 200 

0.77 2447 

0.77 4667 

0.773895 

0.774074 

0. 400 

1. 37 5 317 

1. 37 2759 

1. 373533 

1. 37 3 227 

0.600 

1. 834089 

1, 828286 

1. 830108 

1.829470 

0.800 

2. 187605 

2. 1797 08 

2. 182202 

2. 181348 

1. 000 

2. 46 4865 

2. 4557 14 

2. 458608 

2. 457621 




TABLE 6. 12: P 

w 0# 4 


k 

^1 

A2 

^3 

^4 

0.001 • 

0.003537 

0. 011826 

0.009091 

0. 009886 

0. 005 

0. 018 19 2 

0. 026598 

0.023824 

0.024629 

0. 010 

0. 037 105 

0.045522 

0.0427 43 

0.043649 

0. 040 

0. 156855 

0. 164773 

0, 162153 

0. 16 2906 

0. 100 

0. 407 407 

0. 413657 

0.411574 

0. 412156 

0. 200 

0.819447 

0.82257 3 

0.821500 

0.821763 

0. 400 

1. 543925 

1.54146 2 

1.542197 

1.541892 

0.600 

2.112046 

2. 105530 

2. 10757 2 

2. 106854 

0,800 

2. 5456 48 

2.536 497 

2.539386 

2.538396 

1.000 

2.87 5675 

2.865000 

2.868375 

2. 867 2“ ' 




TABLE 6. 13: p » 0.6 


k 

^1 


"^3 

^4 

0. 001 

0. 002730 

0. 014434 

0.008360 

0.009165 

0. 005 

0. 014287 

0. 022967 

0. 020103 

0. 020935 

0. 010 

0.029541 

0. 03837 0 

0.035456 

0.036802 

0. 040 

0. 134459 

0. 140322 

0. 137392 

0. 138236 

0. 100 

0. 364898 

0. 37 2668 

0.370086 

0.370816 

0. 200 

0.7 9 27 08 

0,797596 

0.795943 

0.795877 

0, 400 

1.6 405 43 

1.689011 

1.639433 

1.639213 

0. 600 

2. 35 2798 

2. 343001 

2. 348124 

2. 347367 

0. 800 

2. 39 44 38 

2.884139 

2. 887 390 

2. 88527 3 

1. 000 

3. 236 486 

3. 27 4 286 

3. 278144 

3. 27 5 8 28 




TABLE 6. 14; p 

ra 0% 9 


k 

^1 

^2 


^4 

0.001 

0.000827 

0.009404 

0.00657 4 

0.007397 

0.005 

0.004446 

0. 013585 

0.010570 

0. 011447 

0. 010 

0.009 404 

0.018954 

0.015803 

0.015719 

0. 040 

0.045914 

0. 0567 44 

0. 053169 

0. 054206 

0. 100 

0. 147053 

0. 158893 

0. 154979 

0. 156109 

0. 200 

0. 395195 

0.406879 

0. 403004 

0.404107 

0.400 

1. 193578 

1. 200348 

1, 198034 

1. 198627 

0.600 

2.276 447 

2.27 4309 

2. 27 4899 

2. 27 45 9 2 

0.800 

3. 285949 

3. 275459 

3. 278753 

3. 277601 

1.000 

3.902703 

3.888214 

3.89 2796 

3. 891233 
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A , ' A - 

percentage risk differences of with ^2 much larger viien 

compared to the corresponding percentage risk differences of 

^ 3 ^n^^ and ^ 3 ( 0 *) with ^ 2 * 0. 6 < k _< 1 , M 2 is the worst and 

the percentage risk differences of the estimators Mo(""^) and 

M^tc*) with M^ sre smaller compared to those of ^2 with m^. Thus, 

(_S_) and Mt(c*) are close to the best estimator in vAiole of 
o n— 1 o 

the region 0 < k _< 1 . 

Similar trends are noticed for negative values of P, 
values of k > 1 and n «» 30 and 50, 

In view of B(i) < < B(c*) and the above risk obser- 

vation, the estimators M 3 ^c*) and ^ 3 ^^^^) are good choices among 
M 3 (c). The estimator M 3 is* however, simpler to compute. 

Remark 6,7,3 : The risk values of M 3 as presented in Table I of 

Kri shnamoorthy and Rohatgi (1988a) corresponding to p =0.2, k = 

0. 1, 0. 2 and 0. 4; p « 0. 4, k - 0. 1 and 0. 2; P = 0.6, k = 0. 1 arxd 
0.2 and p = 0 , 9 , k = 0 . 1, 0. 2 and 0.4 are incorrect; the inequa- 
lity (6.7.6) implies that RCe.M^) > R( 0 ,M 2 ^ f^r these values of 


p and k. 
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